Skip to content

Latest commit

 

History

History
31 lines (18 loc) · 1.24 KB

README.md

File metadata and controls

31 lines (18 loc) · 1.24 KB

Render-3D-pose-from-a-video

Goal: Create 3D pose render from a single RGB Video file.

Workflow:

Video->Detectron(2D Coordinates.npy)/ Detectron2 ->VideoPose3D(3d joints.npy)->bvh_skeleton(.bvh)->Blender(Render outut)->(TODO)Custom mesh with animation

Note : Use https://drive.google.com/file/d/1FSztcynGULFT7nkx6UIppIBy0dBwnmet or https://ufile.io/hi6y4b1d checkpoint to preserve trajectories

How to Use it

  1. clone this repository
  2. Collab -> Open Notebook -> Github -> Run all cells -> Save output in bvh format
  3. Import bvh file to blender, import the human mesh and use diffeomorphic retageter to put the animation on the mesh.

Preview

Input Video

BVH render in blender

Rigged render

References

  1. Detectron: https://github.com/facebookresearch/Detectron/
  2. VideoPose3D: https://github.com/facebookresearch/VideoPose3D
  3. Retarget BVH: http://diffeomorphic.blogspot.com/p/bvh-retargeter.html

*The untitled.blend is an example how everything is implemented and can be used as a reference.