Generating Instrument Sounds Aligned with Video via Human Body Keypoints A Deep Learning Approach to Multimodal Audio-Visual Synthesis

Language: English

Published by GRIN Verlag, 2026

3389179836 / 9783389179833

  • Softcover
  • New
See all details

Seller: Home-set, Mannheim, GermanyHome-set

5-star seller

AbeBooks seller since April 13, 2026

Softcover

Condition: New

£ 16.29

£ 41.65 shipping 
Ships from Germany to U.S.A.

Quantity: 2 available

Add to basket
Free 30-day returns

Item description from seller

Research Paper (undergraduate) from the year 2026 in the subject Computer Science, grade: Good, language: English, abstract: Historical video archives and recordings from the past often suffer from degraded or completely missing audio tracks due to deterioration of storage media, recording limitations of the era, or loss during archival processes. Similarly, silent films and performance documentation may lack synchronized sound entirely. Emerging generative artificial intelligence techniques have demonstrated the potential to reconstruct missing audio content by analyzing visual information alone-a capability particularly valuable for restoring cultural heritage materials and historical performance recordings. However, when applied to complex activities such as musical instrument performance, existing methods have shown limited accuracy in capturing the nuances of sound production. Prior research has established that SpecVQGAN architectures combined with Transformer-based mechanisms can improve video-to-audio generation. This work introduces an enhanced model that augments SpecVQGAN by incorporating human skeletal pose features, specifically designed to elevate the quality of generated musical instrument sounds. Through comprehensive evaluation using both subjective user studies and objective quantitative metrics, we demonstrate that the proposed framework significantly outperforms existing approaches in reconstructing authentic instrumental audio from archival and silent performance videos. Sprache: Englisch Gewicht in Gramm: 73.…

Title
Generating Instrument Sounds Aligned with Video via Human Body Keypoints A Deep Learning Approach to Multimodal Audio-Visual Synthesis
Author
Yasuyuki Tahara, Akihiko Ohsuga, Yuichi Sei, Haruka Okano
Publisher
GRIN Verlag
Publication year
2026
Condition
Neu
Binding
Softcover/Taschenbuch
Language
English
ISBN 10
3389179836
ISBN 13
9783389179833
Item weight
73 grams

Home-set

Mannheim, Germany

5-star seller

AbeBooks seller since April 13, 2026

Shipping rates from Germany to U.S.A.

Item10 to 12 business days8 to 10 business days
First item£ 41.65£ 62.59
Delivery times are set by sellers and vary by carrier and location. Orders passing through Customs may face delays and buyers are responsible for any associated duties or fees. Sellers may contact you regarding additional charges to cover any increased costs to ship your items.

Payment methods

  • Visa
  • Mastercard
  • American Express
  • Apple Pay
  • Google Pay
  • Check

Specialty

Buch

Seller's business information

Home-set

Germany