Akira : Motion Capture for MMD/Blender

Demos and projects
1

Akira : Next-Generation Motion Capture Tool for MMD Creators

Main Features

  • AI-Driven Motion Tracking: Utilizes Google’s MediaPipe technology for high-precision motion capture.
  • Cross-Platform Compatibility: Web-based tool accessible on Windows, macOS, and Linux.
  • GPU Acceleration: Optimized performance with NVIDIA/AMD GPU support for 3x faster processing.
  • Beginner-Friendly Workflow: No complex setup—works directly in modern browsers.

Core Capabilities

  • Real-time motion capture from video input.
  • Export animations as MP4 with embedded motion data.
  • Import custom models (BPMX formats).
  • Manage multiple scenes within a single workspace.

Upcoming Updates
Send your ideas

  1. Support export to .glb/.vmd
  2. Add localizations
  3. Improve calculations

Links

Share Your Creations!

Export your animations as MP4 files to upload directly to YouTube or share with the MMD community. I actively review user-generated content and feedback to improve the tool—your submissions help shape future updates!

Join the discussion and share feedback to help shape the future of Akira MMD!

3 Likes
3

Thank you for using this project. :grinning_face_with_smiling_eyes:

4

image
image458×332 15.5 KB

The movement tracking works very well, but the implementation of the avatar is unfortunately not satisfactory or I’m doing something wrong. :slight_smile:

1 Like
5

The library I use has 2d landmarks and 3d landmarks. 2d images are placed on top of video and they must be very accurate. Unfortunately, this is not the case with 3d. I try to improve the accuracy every day. I hope you will keep an eye on updates, and also if you want to help with the project, write to me in discord nickname: demon16666

1 Like
6

Patch 0.7.1b [05.03.2025]

  1. Removed settings
  2. Added button to remove imported model
  3. Removed unused buttons
  4. Added FreeCamera
  5. Added other buttons

Links

Join the discussion and share feedback to help shape the future of Akira MMD!

1 Like
7

Patch 0.7.1b-1 [09.03.2025]

  1. Returned the settings;
  2. Added to the settings option for short model;
  3. Added Kalman filter, OneEuroFilter for improve motion calculate accuracy

Links

Join the discussion and share feedback to help shape the future of Akira MMD!

8

Exciting News! Update 0.7.2a Highlights :glowing_star:

Here’s what’s coming in the 0.7.2a update:

:sparkles: Revamped Animation Panel: Enjoy full animation saving capabilities in the newly designed animation panel, allowing for more precise adjustments and control over your projects!
:sparkles: Optimized Performance: Enhanced computation efficiency for filters and rotation tools—smoother workflows and faster results!
:sparkles: Streamlined Model Importing: Import models directly without opening settings—save time and jump straight into creativity!
:sparkles: Archive Support: Now compatible with importing models from compressed archives (.zip, .rar, .7z)—no more manual extraction hassles!
:sparkles: Universal Animation Export: Export animations seamlessly to popular formats:

  • .vmd (for MMD projects)
  • .glb (perfect for Blender integration)

Stay tuned—this update is all about smoother workflows, greater flexibility, and powerful new tools!

Let us know your thoughts below! :backhand_index_pointing_down::speech_balloon:

9

Update [v0.7.1a-2] Coming out today:

  • :star2:Export to gltf(blender);
  • :star2:Export to vmd(MMD);
  • :star2:Improved calculation of model position;

I suggest you test the export and write possible errors when the update comes out :slight_smile: