Akira : Motion Capture for MMD/Blender

Demos and projects
1

Akira : Next-Generation Motion Capture Tool for MMD Creators

Main Features

  • AI-Driven Motion Tracking: Utilizes Google’s MediaPipe technology for high-precision motion capture.
  • Cross-Platform Compatibility: Web-based tool accessible on Windows, macOS, and Linux.
  • GPU Acceleration: Optimized performance with NVIDIA/AMD GPU support for 3x faster processing.
  • Beginner-Friendly Workflow: No complex setup—works directly in modern browsers.

Core Capabilities

  • Real-time motion capture from video input.
  • Export animations as MP4 with embedded motion data.
  • Import custom models (BPMX formats).
  • Manage multiple scenes within a single workspace.

Upcoming Updates
Send your ideas

  1. Support export to .glb/.vmd
  2. Add localizations
  3. Improve calculations

Links

Share Your Creations!

Export your animations as MP4 files to upload directly to YouTube or share with the MMD community. I actively review user-generated content and feedback to improve the tool—your submissions help shape future updates!

Join the discussion and share feedback to help shape the future of Akira MMD!

3 Likes
3

Thank you for using this project. :grinning_face_with_smiling_eyes:

4

image
image458×332 15.5 KB

The movement tracking works very well, but the implementation of the avatar is unfortunately not satisfactory or I’m doing something wrong. :slight_smile:

1 Like
5

The library I use has 2d landmarks and 3d landmarks. 2d images are placed on top of video and they must be very accurate. Unfortunately, this is not the case with 3d. I try to improve the accuracy every day. I hope you will keep an eye on updates, and also if you want to help with the project, write to me in discord nickname: demon16666

1 Like
6

Patch 0.7.1b [05.03.2025]

  1. Removed settings
  2. Added button to remove imported model
  3. Removed unused buttons
  4. Added FreeCamera
  5. Added other buttons

Links

Join the discussion and share feedback to help shape the future of Akira MMD!

1 Like
7

Patch 0.7.1b-1 [09.03.2025]

  1. Returned the settings;
  2. Added to the settings option for short model;
  3. Added Kalman filter, OneEuroFilter for improve motion calculate accuracy

Links

Join the discussion and share feedback to help shape the future of Akira MMD!

8

Exciting News! Update 0.7.2a Highlights :glowing_star:

Here’s what’s coming in the 0.7.2a update:

:sparkles: Revamped Animation Panel: Enjoy full animation saving capabilities in the newly designed animation panel, allowing for more precise adjustments and control over your projects!
:sparkles: Optimized Performance: Enhanced computation efficiency for filters and rotation tools—smoother workflows and faster results!
:sparkles: Streamlined Model Importing: Import models directly without opening settings—save time and jump straight into creativity!
:sparkles: Archive Support: Now compatible with importing models from compressed archives (.zip, .rar, .7z)—no more manual extraction hassles!
:sparkles: Universal Animation Export: Export animations seamlessly to popular formats:

  • .vmd (for MMD projects)
  • .glb (perfect for Blender integration)

Stay tuned—this update is all about smoother workflows, greater flexibility, and powerful new tools!

Let us know your thoughts below! :backhand_index_pointing_down::speech_balloon:

9

Update [v0.7.1a-2] Coming out today:

  • :star2:Export to gltf(blender);
  • :star2:Export to vmd(MMD);
  • :star2:Improved calculation of model position;

I suggest you test the export and write possible errors when the update comes out :slight_smile:

10

Alpha test 0.7.1a-2 Changelog [18.03.2025]:

11

Update 0.7.1a-3 Highlights :glowing_star:

What will be added:

  • Experimental correction of calculations of model rotations based on two-dimensional landmarks will be added.
  • Deleting recorded movements.
  • Adding model imports in the format .zip , etc.
  • I will make performance improvements
  • I will add translations into Russian and Japanese.
  • I will add the bone structure as a tree list.

I would also like to tell you about my project: I would like to create a really cool free alternative to the QuickMagic website, if you want to help me or have any ideas, please write

12

:rocket: Project Updates & Releases!

:sparkles: NEW PROJECTS

  • QA (Quick Animation) – Instantly export video data into animations! Lightning-fast workflow for creators. :zap:
  • Akira Application (Windows) – Native app with 4 languages (Русский, 日本語, 中文, English) + revamped scene setup via modal windows (no more hold-to-configure!). Desktop version will outshine the web app in future updates! :desktop:

:wrench: CURRENT IMPROVEMENTS

(In Development)

  • Interactive Hint System – A new ? button with tooltips for all controls. Need a short GIF/video demo soon! :movie_camera:
  • Model Skeleton Toggle – Visualize bone structures with a single click. :skull:
  • Multilingual UI – All buttons, labels, and tooltips translated into 4 languages. :earth_africa:

:date: UPCOMING RELEASES

(Post-Testing Phase)

  • Akira Web MMD Update 0.X.X – Syncing desktop improvements to the web client. :globe_with_meridians:
  • Akira Application v1.0.0b – Beta release (alpha docs in progress). Expect polish and fixes! :tools:
  • Quick Animation v1.0.0 – Stable launch! :clapper:

:bell: Stay tuned for beta test calls, GIF previews, and release timelines!
Let’s make creation smoother, faster, and multilingual! :speech_balloon::rocket:

(React with :video_game: for app updates or :movie_camera: to help create the demo GIF!)

13

Dev logs:

  • When testing the application, I had to adapt many libraries and do a lot of work to adapt the web to the application;
  • When using the application without wasm runtime and wasm model, the performance increased by 1.5-2 times;
  • Also added visualization of all recorded keyframes;

I will also make two separate posts about my developments.