Hi John,
There is an ongoing project soon to be published based on this work aiming to automatically animate HamNoSys into pose sequences, which can drive an avatar.

The idea is simple: take videos and their transcription, and teach the computer to translate from the transcription back to the pose of the video
While this work is limited to HamNoSys, I do not doubt that once more dictionaries like sign2mint or dictio are available via API, it will be extended to SignWriting as well.

This project was 2-3 days of work, and the results are not amazing, however, advances in the field are seemingly promising, and with more work, it will probably look awesome.

Amit


On Thu, Oct 20, 2022 at 9:37 PM John Carlson <[log in to unmask]> wrote:
I suggest we create a mapping between X3D/BVH, DanceWriting/MovementWriting and especially SignWriting, with DanceWriting/MovementWriting and SignWriting carrying the semantics, and X3D/BVH carrying the physics/mathematics.

https://en.m.wikipedia.org/wiki/SignWriting

https://en.m.wikipedia.org/wiki/International_Movement_Writing_Alphabet

I believe there are current developments on this, as  reported on SW-L.

I believe that this, and translation to and/or supplementing with Protactile for the deafblind will go a long way towards making the Metaverse more accessible.

Note that Protactile is a full-duplex, two-way language, so that full-duplex communication is critical to success.

Plain ol’ video generation isn’t going to solve this!

John 

On Thu, Oct 20, 2022 at 1:21 PM Brutzman, Donald (Don) (CIV) <[log in to unmask]> wrote:

Hi John.  Good ideas, thanks for sharing them.

 

Once again, it appears as if all the capabilities necessary to accomplish that are defined in X3D4 with immense sets of BVH captures available out there.  Good hunting, sir.

 

 

 

all the best, Don

--

Don Brutzman  Naval Postgraduate School, Code USW/Br        [log in to unmask]

Watkins 270,  MOVES Institute, Monterey CA 93943-5000 USA    +1.831.656.2149

X3D graphics, virtual worlds, Navy robotics https:// faculty.nps.edu/brutzman

 

From: John Carlson <[log in to unmask]>
Sent: Thursday, October 20, 2022 10:46 AM
To: Brutzman, Donald (Don) (CIV) <[log in to unmask]>
Cc: X3D Public Mailing List ([log in to unmask]) <[log in to unmask]>; [log in to unmask]
Subject: Re: [x3d-public] X3D4 Working Group agenda, 20 OCT 2022: discuss possible Avatar strategy

 

Hmm.  I suggest extending the BVH to include multifigure collaborative motions like dancing (think Virginia Reel) and sports.  That is, some kind of composed BVH with multiple avatars.

 

This may already be done.

 

Thanks!

 

On Thu, Oct 20, 2022 at 11:46 AM Brutzman, Donald (Don) (CIV) <[log in to unmask]> wrote:

X3D Working Group meets weekly for continued advancement of the X3D4 Specifications.

 

·        Meeting time 09-1000 pacific, each Friday

·        https://us02web.zoom.us/j/81634670698?pwd=a1VPeU5tN01rc21Oa3hScUlHK0Rxdz09

·        https://zoom.us/j/148206572  Password 483805

·        https://www.web3d.org/member/teleconference-information

 

Here is a “new” proposed strategy, trying to say crisply the many essential ideas that are well known already by active participants in the X3D community.

 

 

(draft) Avatar Strategy: Open, Interoperable, Personal, Secure

 

No standardized definition for “avatars” is provided in X3D4, but…

 

·        Many alternatives are possible, the “X” in “X3D” is Extensible. Vive la difference!

·        X3D includes multiple levels of detail (LOD) if progressive avatar fidelity desired, this is essential for hugely scalable worlds.

·        Most powerful Web3D example design to date:  Silhouette Avatars by IVN, https://ivn.net

·        Metadata for identity, secure digital signature and even encryption is possible.

·        Composing 3D scans and motion-capture (mocap) data for full avatar realism remains really interesting!  Interesting progress continues on this challenge.

 

X3D Working Group intends to demonstrate whatever avatar definitions are agreed upon by Metaverse Standards Forum.  We expect to show full matching Implementation and Evaluation using X3D, learning further what avatar designs work well.

 

 

Let’s discuss please.  All inputs and discussion welcome.

 

Corresponding Web3D member-only draft slideset available at

 

Membership has value!

  • Join the Web3D Consortium
  • The Web3D Consortium is a non-profit group open to industry, academic, government and individual members.
  • https://www.web3d.org/join

 

Have fun with X3D, Human Animation and Avatars!  8)

 

all the best, Don

--

Don Brutzman  Naval Postgraduate School, Code USW/Br        [log in to unmask]

Watkins 270,  MOVES Institute, Monterey CA 93943-5000 USA    +1.831.656.2149

X3D graphics, virtual worlds, Navy robotics https:// faculty.nps.edu/brutzman

 

_______________________________________________
x3d-public mailing list
[log in to unmask]
http://web3d.org/mailman/listinfo/x3d-public_web3d.org

________________________________________________

SIGNWRITING LIST INFORMATION

Valerie Sutton SignWriting List moderator [log in to unmask]

Post Messages to the SignWriting List: [log in to unmask]

SignWriting List Archives & Home Page http://www.signwriting.org/forums/swlist

Join, Leave or Change How You Receive SW List Messages http://listserv.valenciacollege.edu/cgi-bin/wa?SUBED1=SW-L&A=1

________________________________________________

SIGNWRITING LIST INFORMATION

Valerie Sutton SignWriting List moderator [log in to unmask]

Post Messages to the SignWriting List: [log in to unmask]

SignWriting List Archives & Home Page http://www.signwriting.org/forums/swlist

Join, Leave or Change How You Receive SW List Messages http://listserv.valenciacollege.edu/cgi-bin/wa?SUBED1=SW-L&A=1