Search

EP-4738836-A1 - MPEG HAPTICS SYNTHESIZER OPTIMIZATION FOR GENERATING HIGH FREQUENCY SIGNAL

EP4738836A1EP 4738836 A1EP4738836 A1EP 4738836A1EP-4738836-A1

Abstract

A system, codec and method of optimizing an MPEG haptics synthesizer are disclosed. The method includes determining a minimum sampling rate, generating a haptic signal with the determined minim sampling rate and upsampling the generated haptic signal to synthesize a final haptic signal. The optimizing may include determining a minimum sampling rate by an end user, by an automatic computation. The optimizing may include upsampling of the generated haptic signal based on a target sampling rate. The optimizing may include the defined by content creator causes a value of the minimum sampling rate to be stored with haptic data. The optimizing may include, in a context of the MPEG haptic standard, the minimum sampling rate being part of the normative part of the specification, the minimum sampling rate being stored as an optional value of a haptic experience level, or the minimum sampling rate being stored for each band.

Inventors

  • LECUYER, Gurvan
  • GALVANE, Quentin
  • GUILLOTEL, PHILIPPE

Assignees

  • InterDigital CE Patent Holdings, SAS

Dates

Publication Date
20260506
Application Date
20241104

Claims (15)

  1. A method of optimizing MPEG haptics synthesizer, the method comprising: determining a minimum sampling rate; generating a haptic signal with the determined minimum sampling rate; and upsampling the generated haptic signal to synthesize a final haptic signal.
  2. A codec comprising: a haptic synthesizer operating to: determine a minimum sampling rate; generate a haptic signal with the determined minimum sampling rate; and upsample the generated haptic signal to synthesize a final haptic signal.
  3. The method of claim 1 or the codec of claim 2, wherein the minimum sampling rate is determined based on input from a user.
  4. The method of claim 1 or the codec of claim 2, wherein determining a minimum sampling rate is performed by an automatic computation.
  5. The method of claim 1 or the codec of claim 2, wherein the upsampling of the generated haptic signal is based on a target sampling rate.
  6. The method of claim 1 or the codec of claim 2, wherein the minimum sampling rate is based on at least one of a parameter specified by a content creator and stored in an MPEG haptic format, a parameter computed from a haptic content using signal analysis, and a parameter specified by a user.
  7. The method of claim 6 or the codec of claim 6, wherein the parameter specified by the content creator represents a value of the minimum sampling rate.
  8. The method of claim 7 or the codec of claim 7, wherein in a context of the MPEG haptic standard, the parameter representing the value of the minimum sampling rate is a normative part of the specification.
  9. The method of claim 7 or the codec of claim 7, wherein in a context of the MPEG haptic standard, the parameter representing the value of the minimum sampling rate is an optional parameter defined at a haptic experience level.
  10. The method of claim 7 or the codec of claim 7, wherein in the MPEG haptic standard, the parameter representing the value of the minimum sampling rate is stored for each band of a data structure.
  11. The method of claim 6 or the codec of claim 6, wherein the minimum sampling rate is automatically computed and used to generate the haptic signal.
  12. The method of claim 11 or the codec of claim 11, wherein the minimum sampling rate is based on an upper maximum frequency stored at a band level.
  13. The method of claim 6 or the codec of claim 6, wherein the minimum sampling rate is a synthesizer parameter.
  14. The method of claim 13 or the codec of claim 13, wherein the minimum sampling rate is provided at a time of synthesis.
  15. The method of claim 14 or the codec of claim 14, wherein an end user determines a value of the minimum sampling rate.

Description

BACKGROUND The current implementation of the synthesizer is using a loop over the whole data structure to generate the final signal. The signal generation computational cost is growing linearly with the sample rate value. The signal generation computational cost grows even more when a high number of keyframes are used to describe the haptic effect. SUMMARY A system, codec and method of optimizing an MPEG haptics synthesizer are disclosed. The method includes determining a minimum sampling rate, generating a haptic signal with the determined minim sampling rate and upsampling the generated haptic signal to synthesize a final haptic signal. The method may include determining a minimum sampling rate by an end user. The method may include determining a minimum sampling rate by an automatic computation. The method may include upsampling of the generated haptic signal based on a target sampling rate. The method may include the minimum sampling rate being based on at least one of defined by a content creator and stored in the MPEG haptic format, automatically computed using signal analysis, and specified directly as a parameter of the MPEG haptic synthesizer by a user. The method may include the defined by content creator causes a value of the minimum sampling rate to be stored with haptic data. The method may include, in a context of the MPEG haptic standard, the minimum sampling rate being part of the normative part of the specification, the minimum sampling rate being stored as an optional value of a haptic experience level, or the minimum sampling rate being stored for each band of a data structure. The method may include the minimum sampling rate being automatically computed and used to generate the haptic signal. The method may include the minimum sampling rate being based on an upper maximum frequency stored at a band level. The method may include the minimum sampling rate being a synthesizer parameter. The method may include the minimum sampling rate being provided at a time of synthesis. The method may include an end user determining a value of the minimum sampling rate. The codec includes a haptic synthesizer operating to determine a minimum sampling rate, generate a haptic signal with the determined minim sampling rate and upsample the generated haptic signal to synthesize a final haptic signal. The codec may include the haptic synthesizer being further configured to determine the minimum sampling rate by an automatic computation. The codec may include the upsampling of the generated haptic signal being based on a target sampling rate. The codec may include the minimum sampling rate being based on at least one of defined by a content creator and stored in a MPEG haptic format, automatically computed using signal analysis, and specified directly as a parameter of the haptic synthesizer by a user. The codec may include, in a context of a MPEG haptic standard, the minimum sampling rate being part of the normative part of the specification, stored as an optional value of a haptic experience level, or stored for each band of a data structure. The codec may include the minimum sampling rate being automatically computed and used to generate the haptic signal. BRIEF DESCRIPTION OF THE DRAWINGS A more detailed understanding may be had from the following description, given by way of example in conjunction with the accompanying drawings, wherein like reference numerals in the figures indicate like elements, and wherein: FIG. 1 illustrates a moving picture experts group (MPEG) haptics data structure;FIG. 2 illustrates a haptic signal (bottom) and the decomposition in two frequency bands (top);FIG. 3 illustrates a haptic encoder architecture according to embodiments of the present invention;FIG. 4A illustrates the pipeline of the automatic computation of SRmin and synthesis of the final haptic signal according to embodiments of the present invention;FIG. 4B illustrates the pipeline when the value SRmin is given by the end user for the synthesizer according to embodiments of the present invention;FIG. 5 illustrates a method of optimizing MPEG haptics synthesizer;FIG. 6A illustrates a resulting signal when the haptic signal according to an aspect of the present invention is subtracted from a reference signal;FIG. 6B illustrates a resulting signal when the haptic signal according to an aspect of the present invention is subtracted from a reference signal;FIG. 6C illustrates a resulting signal when the haptic signal according to an aspect of the present invention is subtracted from a reference signal;FIG. 6D illustrates a resulting signal when the haptic signal according to an aspect of the present invention is subtracted from a reference signal;FIG. 6E illustrates a resulting signal when the haptic signal according to an aspect of the present invention is subtracted from a reference signal; andFIG. 6F illustrates a resulting signal when the haptic signal according to an aspect of the present invention is subtracted fro