Skip to content

sign-language-processing/signwriting-animation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

SignWriting Animation

This project aims to automatically animate SignWriting into skeletal poses.

This is the reverse of signwriting-transcription.

We would ideally like to have to implementations:

  • diffusion - a diffusion-based method to animate SignWriting
  • translation - a translation-based method to animate SignWriting using the sign-vq model.

Usage

pip install git+https://github.com/sign-language-processing/signwriting-animation

To animate a SignWriting FSW sequence into a .pose file:

signwriting_to_pose --signwriting="M525x535S2e748483x510S10011501x466S2e704510x500S10019476x475" --pose="example.pose"

When generating full sentences, it is recommended to post-process the .pose files using fluent-pose-synthesis.

Data

The full data is available in sign/data. These examples are taken from the DSGS Vokabeltrainer:

00004 00007 00015
SignWriting
Video

About

Automatic animation from SignWriting to skeletal pose animation

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published