Skip to content

Conversation

@Erol444
Copy link

@Erol444 Erol444 commented May 27, 2023

Started integrating @geaxgx's depthai-hand-tracker into the SDK.

TODO:

  • Move HandTrackerRenderer logic into SDK's Visualizer
  • Support 3D hand landmarks (calculation & visualization)
  • Support body pre-focusing
  • Code cleanup
  • Support different model sizes (hand landmarks: lite/full/sparse, perhaps palm_detection_192x192)

Demo

2023-05-27.17-05-43.mp4

Code example

from depthai_sdk import OakCamera
from depthai_sdk.components.hand_tracker.renderer import HandTrackerRenderer
from depthai_sdk.classes.packets import HandTrackerPacket
import cv2

with OakCamera() as oak:
    color = oak.create_camera('color')

    handtracker = oak.create_hand_tracker(color)

    render = HandTrackerRenderer(handtracker)
    def cb(packet: HandTrackerPacket):
        render.draw(packet.color_frame, packet.hands)
        cv2.imshow("Hand tracking", render.frame)

    oak.callback(handtracker, cb)
    oak.visualize(handtracker.out.palm_detection)
    oak.visualize(handtracker.out.palm_crop)

    # oak.show_graph()
    oak.start(blocking=True)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants