Posts by Collection

portfolio

Automatic Soft Packaging Items Sorting Robot

2019

Trained Fast-RCNN network using MMDetection framework to detect the color and location of clothes.
Carried out kinematics simulation on puma-560 robot and trajectory planning of the manipulator arm using Matlab Robotics Toolbox.
Established communication between Python and Matlab program to run the clothing detection and the motion of the simulated robot synchronously.

RF-Signal-based Human Pose Estimation

2020

Applied Radio Frequency (RF) signals for human pose estimation; succeeded in operation in dark light and passing through obstacles while being more sensitive to biological characteristics.

Gomoku Player using EFORT Robotic Arm

2020

Programmed a robotic arm that could play Gomoku with human interactively.
Retrieved global information through camera-on-hand, deployed template matching to locate the pieces on board; mapped between the physical locations and the logical position on virtual grid board.
Integrated a Game Theory based AI into the host computer to handle vision information, location mapping and decision process, which communicates with the robot through socket.

Personal Cloud Service

2020

I built a personal cloud service at home, covering everything from hardware to software. It offers VPN connectivity, file storage, media services, and an ML computing node, among other functionalities.

Heterogenous Cooperative Robot System Design

2020

Designed a group of cooperative robots for supermarket replenishment in Webots simulation, which is made up of DJI Mavic Pro and KUKA Youbot.
Developed a Quadcopter flight controller for DJI Mavic, which also supervises and schedules the replenishment process; then developed the mobile arm (KUKA Youbot) controller for navigation, which will grab and place the items under the guidance of DJI Mavic. The two robots communicate through HTTP interface.

Lifelong Multi-Agent Path Finding (MAPF)

2021

Established physical simulation on Webots and implemented PID controller for robot trajectory tracking.
Proposed an improved bi-directional A* to avoid potential collision caused by imperfect controller trajectory, and a centralized two-stage Conflict-Based Search(CBS) algorithm to complete the lifelong MAPF task.

Partial Duplicate Video Retrieval based on Deep Metric Learning

2021

Extracted video feature through VGG-16 backbone network and applied Deep Metric Learning (DML) for video similarity calculation.
Proposed a video segmentation method based on the above extracted video feature using a DNN model, which can effectively segment different scenes in a long video.
Developed a multi-thread downloader for efficiently downloading the large CC_WEB_VIDEO dataset and built a segmentation dataset from Bilibili and Youtube, which contains 36,600 samples.

Action Evaluation Based on Monocular RGB Video

2021

Introduced new metrics for video pose evaluation and realized action counting for gym actions.
Deployed OpenPose and ST-GCN for human pose estimation and action recognition.
Designed an action segmentation method based on keyframe extraction and clustering (PCA & K-means).
Proposed a weak-rigid transformation for pose registration and defined a pose feature descriptor.