Algorithm Ⅰ: Geometric body shape regeneration scheme |
Step 1 Select the parameters |
Step 2 For the given |
Step 3 Use the training dataset |
Step 4 For a new characteristic set |
Step 5 Compute the Fourier coefficients |
Step 6 Select the sampling mesh |
In this paper, we are concerned with the three-dimensional (3D) geometric body shape generation with several well-selected characteristic values. Since 3D human shapes can be viewed as the support of the electromagnetic sources, we formulate a scheme to regenerate 3D human shapes by inverse scattering theory. With the help of vector spherical harmonics expansion of the magnetic far field pattern, we build on a smart one-to-one correspondence between the geometric body space and the multi-dimensional vector space that consists of all coefficients of the spherical vector wave function expansion of the magnetic far field pattern. Therefore, these coefficients can serve as the shape generator. For a collection of geometric body shapes, we obtain the inputs (characteristic values of the body shapes) and the outputs (the coefficients of the spherical vector wave function expansion of the corresponding magnetic far field patterns). Then, for any unknown body shape with the given characteristic set, we use the multivariate Lagrange interpolation to get the shape generator of this new shape. Finally, we get the reconstruction of this unknown shape by using the multiple-frequency Fourier method. Numerical examples of both whole body shapes and human head shapes verify the effectiveness of the proposed method.
Citation: Youzi He, Bin Li, Tingting Sheng, Xianchao Wang. Generating geometric body shapes with electromagnetic source scattering techniques[J]. Electronic Research Archive, 2020, 28(2): 1107-1121. doi: 10.3934/era.2020061
[1] | Youzi He, Bin Li, Tingting Sheng, Xianchao Wang . Generating geometric body shapes with electromagnetic source scattering techniques. Electronic Research Archive, 2020, 28(2): 1107-1121. doi: 10.3934/era.2020061 |
[2] | Yao Sun, Lijuan He, Bo Chen . Application of neural networks to inverse elastic scattering problems with near-field measurements. Electronic Research Archive, 2023, 31(11): 7000-7020. doi: 10.3934/era.2023355 |
[3] | Xinlin Cao, Huaian Diao, Jinhong Li . Some recent progress on inverse scattering problems within general polyhedral geometry. Electronic Research Archive, 2021, 29(1): 1753-1782. doi: 10.3934/era.2020090 |
[4] | Yujie Wang, Enxi Zheng, Wenyan Wang . A hybrid method for the interior inverse scattering problem. Electronic Research Archive, 2023, 31(6): 3322-3342. doi: 10.3934/era.2023168 |
[5] | Yan Chang, Yukun Guo . Simultaneous recovery of an obstacle and its excitation sources from near-field scattering data. Electronic Research Archive, 2022, 30(4): 1296-1321. doi: 10.3934/era.2022068 |
[6] | Jiyu Sun, Jitao Zhang . Muti-frequency extended sampling method for the inverse acoustic source problem. Electronic Research Archive, 2023, 31(7): 4216-4231. doi: 10.3934/era.2023214 |
[7] | John Daugherty, Nate Kaduk, Elena Morgan, Dinh-Liem Nguyen, Peyton Snidanko, Trung Truong . On fast reconstruction of periodic structures with partial scattering data. Electronic Research Archive, 2024, 32(11): 6481-6502. doi: 10.3934/era.2024303 |
[8] | Longkui Jiang, Yuru Wang, Weijia Li . Regress 3D human pose from 2D skeleton with kinematics knowledge. Electronic Research Archive, 2023, 31(3): 1485-1497. doi: 10.3934/era.2023075 |
[9] | Weishi Yin, Jiawei Ge, Pinchao Meng, Fuheng Qu . A neural network method for the inverse scattering problem of impenetrable cavities. Electronic Research Archive, 2020, 28(2): 1123-1142. doi: 10.3934/era.2020062 |
[10] | Deyue Zhang, Yukun Guo . Some recent developments in the unique determinations in phaseless inverse acoustic scattering theory. Electronic Research Archive, 2021, 29(2): 2149-2165. doi: 10.3934/era.2020110 |
In this paper, we are concerned with the three-dimensional (3D) geometric body shape generation with several well-selected characteristic values. Since 3D human shapes can be viewed as the support of the electromagnetic sources, we formulate a scheme to regenerate 3D human shapes by inverse scattering theory. With the help of vector spherical harmonics expansion of the magnetic far field pattern, we build on a smart one-to-one correspondence between the geometric body space and the multi-dimensional vector space that consists of all coefficients of the spherical vector wave function expansion of the magnetic far field pattern. Therefore, these coefficients can serve as the shape generator. For a collection of geometric body shapes, we obtain the inputs (characteristic values of the body shapes) and the outputs (the coefficients of the spherical vector wave function expansion of the corresponding magnetic far field patterns). Then, for any unknown body shape with the given characteristic set, we use the multivariate Lagrange interpolation to get the shape generator of this new shape. Finally, we get the reconstruction of this unknown shape by using the multiple-frequency Fourier method. Numerical examples of both whole body shapes and human head shapes verify the effectiveness of the proposed method.
Recent advances in technology have enabled the construction of high-density point data sets that describe the surfaces of real objects, such as the human body. This development has brought an increasing number of important applications in modern industries, like mechanical engineering, film making, clothing industry and virtual game design. Moreover, the realism of virtual humans can be used in health and fitness research, including evaluation of body composition, study of nutritional disorders (obesity, coronary artery disease, metabolic arthritis and etc). All of the methods for capturing and processing three-dimensional (3D) human surface data could be mainly categorized into three types—silhouette-based methods, marker-based methods and measurement-based methods. When using the silhouette method [13], a silhouette of the whole human body is photographed on a reduced scale from different directions to obtain measurements of 3D geometric shapes by re-reading of two-dimensional (2D) forms, which can be extracted relatively robustly from images and they encode a great deal of information to recover 3D shapes. However, the performance of this method is limited due to artifacts such as shadow and noisy background segmentation. Marker-based body capture systems acquire the positions of the markers, which are attached to the surface of the body and create a complete surface mesh given the sparse marker positions [1]. While silhouette-based methods and marker-based methods are effective and visually convincing, these types of approaches need to take several measurements on every subject in the sample, which are costly, time consuming and labour intensive. Besides, these methods could easily become ineffective when the subjects wear heavy or baggy garments.
The above-mentioned defects of these methods motivate researchers to adopt simple and time-efficient measurement-based methods [12]. Using anthropometric landmarks, i.e. several well-selected features of the body shape as characteristic values is the usual way to model human body. Among the options of the characteristic values, the qualitative description of body shape such as body attributes (banana, pear, apple or hourglass) can reflect the overall characteristics of the body shape. And this kind of parameters can significantly reduce the number of characteristic values needed. The most relevant numerical values to these attributes is hip-to-waist ratio (HWR). Another parameter that can characterize body shape globally is body mass index (BMI), which can not be obtained from the silhouette-based or the marker-based data. Furthermore, it is obvious that such characteristic values are relatively insusceptible to articulation changes than those silhouettes measurements. By employing the appropriate parameters, one can determine the decent body shape uniquely. Recently, Li et al. [4] built a novel system, which borrows the source scattering and machine learning techniques to generate the desired geometric body shape by a couple of input characteristic values, such as height and relative weight.
In this paper, we consider to borrow the electromagnetic source scattering techniques to generate 3D human shapes. Our reconstruction scheme relies on the fact that we can view the body as the support of the electromagnetic source
∇×E−iωμ0H=0,∇×H+iωε0E=J, | (1.1) |
where
A pivotal idea in our method is that we view the 3D human shape as the support of the electromagnetic source. Therefore we could resort to electromagnetic source scattering techniques. For the electromagnetic waves, due to their relatively small wavelength compared with the wavelength of acoustic wave and because we can expect the optimum resolution to be around the half wavelength, our method is superior to most existing methods in terms of fineness. Moreover, unlike many other methods, which are based on non-Euclidean approximation and interpolation or function interpolation [4], our method only needs to deal with vector interpolation. This makes the proposed scheme easy to implement. Numerical examples of both the whole body shapes and the human head shapes illustrate the effectiveness and high-precision of our method.
The rest of the paper is organized as follows. In the next section, we give the definition of the geometric body shape space and the characteristic value space. In Section 3, we describe the multi-frequency direct and inverse electromagnetic source scattering problem. After that, we develop a novel scheme for geometric body shape generation in Section 4. We first introduce the notion—shape generator. Then we use the training dataset to train the learning model by multivariate Lagrange interpolation. Finally, the geometric body shape is reconstructed by the multiple-frequency Fourier method. In Section 5, we conduct two 3D experiments to illustrate the effectiveness and high-precision of the proposed method. In this paper, we use bold font to signify vectorial quantities (typically in 3D).
In this section, we recall some elementary knowledge about the shape manifold theory, which will be used in our subsequent research.
Definition 2.1. Let
Actually, the above definition includes much general geometric shape. In our study, we are exclusively consider cases in which
Obviously, more complex the geometric shape is, more characteristic values associated with it needed. For those complicated shapes, such as human body, the cardinality of the set of characteristic values may be infinite. However, for realistic reason, we always consider finite characteristic values for those complicated geometric shape. In our study, we consider the following space
S:=U×V |
where
A critical idea in our method is that the 3D human shape can be regarded as the support of the electromagnetic source. So, in this section, we present some knowledge about the electromagnetic source scattering problem that are pertinent to our subsequent study. We assume the time-harmonic resultant electromagnetic field
lim|x|→+∞|x|(√μ0H׈x−√ε0E)=0, | (3.1) |
for all directions
In this work, we will assume that the electromagnetic source
J=pf, |
where
f={1,in U,0,otherwise, | (3.2) |
and the polarization vector
Using the vectorial Green function, the radiating fields to the Maxwell system (1.1), (3.1) can be written as
E(x)=iωμ0(I+1k2∇∇⋅)∫R3Φ(x,y)J(y)dy, | (3.3) |
H(x)=∇×∫R3Φ(x,y)J(y)dy, | (3.4) |
where
Φ(x,y)=eik|x−y|4π|x−y|,x≠y, |
is the fundamental solution to the Helmholtz equation. The radiating solution to the Maxwell system has the asymptotic form [2],
E(x)=eik|x||x|{E∞(ˆx)+O(1|x|)}, H(x)=eik|x||x|{H∞(ˆx)+O(1|x|)}, |x|→+∞. |
With the help of integral representations (3.3) and (3.4), we obtain
E∞(ˆx)=iωμ04π(I−ˆxˆx⊤)∫R3e−ikˆx⋅yJ(y)dy, | (3.5) |
H∞(ˆx)=ik4πˆx×∫R3e−ikˆx⋅yJ(y)dy. | (3.6) |
With the above formulation, the multi-frequency electromagnetic direct source problem and inverse source problem can be stated as follows:
Direct Problem. Given a fixed polarization vector
Inverse Problem. Given a fixed polarization vector
The definitions of
Based on the sound theoretical basis for electromagnetic source scattering, we proceed to formulate a novel scheme, which can generate 3D human shapes with partial input parameters.
In this section, we will bring in an important notion, shape generator, so we can establish the one-to-one correspondence between the geometric shape space and a finite dimensional vector space. For self-containment, we first give the definition of the finite set
Definition 4.1. Let
kl:={2πα|l|∞,l∈Z3∖{0}, |l|∞≤N1,2παλ,l=0. |
The corresponding observation direction that consists in the set
ˆxl:={ˆl,l∈Z3∖{0}, |l|∞≤N1,(1,0,0)⊤,l=0, | (4.1) |
where
P:={p∈S2|p׈xl≠0}, |
where
According to Theorem 3.1 in [15] and the integral representations (3.5) and (3.6), we know that there is a one-to-one correspondence between the geometric body shape
Next, we give the spherical vector wave function expansion of the magnetic far-field pattern. Let
Vmn(ˆx)=1√n(n+1)GradYmn(ˆx),Wmn(ˆx)=ˆx×Vmn(ˆx),ˆx∈S2. |
Let
H∞=∞∑n=1n∑m=−n(an,mVmn+bn,mWmn), |
with the coefficients
an,m=∫S2H∞⋅¯Vmnds,bn,m=∫S2H∞⋅¯Wmnds, | (4.2) |
where the overline denotes the complex conjugate. In practical applications, the infinite series
H∞,N0=N0∑n=1n∑m=−n(an,mVmn+bn,mWmn),N0∈N. | (4.3) |
Remark 4.2. From the previous analysis, ignoring the negligible truncation errors, we have established a one-to-one correspondence between the geometric body space and the finite dimensional vector space that consists of coefficients
Hence, we could call such vector as the shape generator. We give the following formal definition.
Definition 4.3. For a simply-connected bounded geometric shape
(an,m(k;U),bn,m(k;U):m=−n,⋯,n;n=1,⋯,N0;k∈K) |
is called the shape generator of
After establishing the one-to-one correspondence between the geometric body space and the finite dimensional vector space, we actually obtain the one-to-one correspondence between two finite dimensional vector spaces, which contain the characteristic values of the geometric body shapes and the shape generators of the geometric body shapes, respectively. In this part, we introduce the approach, by which we obtain the shape generator of a unknown geometric body shape from the given characteristic values of this shape.
For a collection of the geometric body shapes
Definition 4.4. For each given geometric body shape
The training dataset consists of a collection of geometric body shapes with their characteristic values and the corresponding shape generators, which can be calculated before training. Here, we aim to establish a learning model
Rea(k)n,m:=F(k)1,n,m(ψ1,⋯,ψN),Ima(k)n,m:=F(k)2,n,m(ψ1,⋯,ψN),Reb(k)n,m:=F(k)3,n,m(ψ1,⋯,ψN),Imb(k)n,m:=F(k)4,n,m(ψ1,⋯,ψN), |
respectively. Without loss of generality, we give the elaborate description of one learning model construction as following.
Let
F(2πa)1,1,−1(ψ1,⋯,ψN)=∑ej⋅1≤qβejΨej, |
where the
A=[Ψe11⋯ΨeS1⋮⋮Ψe1i⋯ΨeSi⋮⋮Ψe1S⋯ΨeSS]. |
Since
Ai(Ψ)=[Ψe11⋯ΨeS1⋮⋮Ψe1⋯ΨeS⋮⋮Ψe1S⋯ΨeSS]←ith row. |
Obviously,
F(2πa)1,1,−1=S∑i=1Rea(2πa)1,−1,idet(Ai(Ψ))det(A). |
Following the same steps, we can get similar Lagrange interpolation expressions of
Until now, learning models have been established. For a new unknown geometric body shape
With the help of previous results, we can use the multiple-frequency Fourier method [15] to reconstruct the unknown shape
Firstly, we recall the Fourier basis functions
ϕl(x)=exp(i2παl⋅x), l∈Z3,x∈R3. | (4.4) |
The Fourier expansion of the electric current density
J=pf=p∑l∈Z3ˆflϕl, |
where the Fourier coefficients are given by
ˆfl=1α3∫Df(x)¯ϕl(x)dx. |
By Definition 4.1, the Fourier basis functions (4.4) can be rewritten as
ϕl(x)=exp(iklˆl⋅x), l∈Z3,x∈R3. |
For every
ˆfl=4πˆxl×p⋅˜H∞(ˆxl,kl;Unew)iklα3|ˆxl×p|2. | (4.5) |
For
ˆf0=λπα3sinλπ(4πˆx0×p⋅˜H∞(ˆx0,k0;Unew)ik0|ˆx0×p|2−∑l∈Z3∖{0}ˆfl∫Dexp(i(klˆl−k0ˆx0)⋅y)dy). | (4.6) |
All
JN1=p∑|l|∞≤N1ˆflϕl, | (4.7) |
where
ˆf0≈λπα3sinλπ(4πˆx0×p⋅˜H∞(ˆx0,k0;Unew)ik0|ˆx0×p|2−∑1≤|l|∞≤N1ˆfl∫Dexp(i(klˆl−k0ˆx0)⋅y)dy). | (4.8) |
With the above preparations, we are ready to formulate the geometric body shape regeneration scheme in Algorithm Ⅰ as follows.
Algorithm Ⅰ: Geometric body shape regeneration scheme |
Step 1 Select the parameters |
Step 2 For the given |
Step 3 Use the training dataset |
Step 4 For a new characteristic set |
Step 5 Compute the Fourier coefficients |
Step 6 Select the sampling mesh |
In this section, we conduct some numerical experiments to illustrate the effectiveness of our shape regeneration method.
First, for each given shape
Next, we present the implementation of multivariate Lagrange interpolation. Given the characteristic values
{{ψp(Us)}Np=1; (an,m(k;Us),bn,m(k;Us):m=−n,⋯,n;n=1,⋯,N0;k∈K)}Ss=1. |
Here the input datum and the output datum are defined by
zs={ψp(Us)}Np=1∈RN,ys={an,m(k;Us),bn,m(k;Us)}m=−n,⋯,n;n=1,⋯,N0;k∈K∈C2N0(N0+2)(N1+1). |
Therefore, we establish the mapping from the characteristic set to the shape generator. Moreover, for each wavenumber
Finally, we specify details of reconstructing the geometry body shape. As discussed above, reconstructing the geometry body shape is equal to reconstructing the electromagnetic source function
In the following examples, the parameters are given by
Example 5.1. In the first example, we aim to reconstruct a 3D whole human body shape. The training dataset consists of
Example 5.2. In this example, we would like to extract some more detailed feature values so that we could reconstruct details on the human body shape. Here, we consider reconstructing the 3D human head shape and devote to determining the details of the head. The training dataset consists of
The authors would like to thank Professor Hongyu Liu of City University of Hong Kong for proposing this research as well as for providing many helpful discussions during the completion of this paper. The work of Bin Li was supported by the Development Plan of Young Innovation Team in Colleges and Universities of Shandong Province under Grant 2019KJN011. The work of Xianchao Wang was supported by the Hong Kong Scholars Program grant under No. XJ2019005 and the NSFC grant under No. 11971133.
[1] |
SCAPE: Shape completion and animation of people. ACM Transactions on Graphics (TOG) (2005) 24: 408-416. ![]() |
[2] |
D. Colton and R. Kress, Inverse Acoustic and Electromagnetic Scattering Theory, Applied Mathematical Sciences, Vol. 93. Springer-Verlag, Berlin, 1998. doi: 10.1007/978-3-662-03537-5
![]() |
[3] |
Two single-shot methods for locating multiple electromagnetic scatterers. SIAM J. Appl. Math. (2013) 73: 1721-1746. ![]() |
[4] |
An inverse scattering approach for geometric body generation: A machine learning perspective. Mathematics in Engineering (2019) 1: 800-823. ![]() |
[5] |
Locating multiple multiscale acoustic scatterers. Multiscale Model. Simul. (2014) 12: 927-952. ![]() |
[6] |
TE/TM decomposition of electromagnetic sources. IEEE Trans. Antennas and Propagation (1988) 36: 1382-1388. ![]() |
[7] |
H. Liu, A global uniqueness for formally determined inverse electromagnetic obstacle scattering, Inverse Problems, 24 (2008), 035018, 13 pp. doi: 10.1088/0266-5611/24/3/035018
![]() |
[8] |
Mosco convergence for H(curl) spaces, higher integrability for Maxwell's equations, and stability in direct and inverse EM scattering problems. J. Eur. Math. Soc. (JEMS) (2019) 21: 2945-2993. ![]() |
[9] |
Reflection principle for the Maxwell's equations and its application to inverse electromagnetic scattering problem. Inverse Problems (2007) 23: 2357-2366. ![]() |
[10] |
Uniqueness in an inverse acoustic obstacle scattering problem for both sound-hard and sound-soft polyhedral scatterers. Inverse Problems (2006) 22: 515-524. ![]() |
[11] |
On multivariate Lagrange interpolation. Math. Comp. (1995) 64: 1147-1170. ![]() |
[12] | H. Seo, F. Cordier and N. Magnenat-Thalmann, Synthesizing animatable body models with parameterized shape modifications, Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation. Eurographics Association, (2003), 120–125. |
[13] | M. Takada and T. Esaki, Method and apparatus for measuring human body or the like, U.S. Patent, (1983), 406–544. |
[14] |
Solving the multi-frequency electromagnetic inverse source problem by the Fourier method. J. Differential Equations (2018) 265: 417-443. ![]() |
[15] |
Fourier method for identifying electromagnetic sources with multi-frequency far-field data. J. Comput. Appl. Math. (2019) 358: 279-292. ![]() |
[16] |
D. Zhang and Y. Guo, Fourier method for solving the multi-frequency inverse source problem for the Helmholtz equation, Inverse Problems, 31 (2015), 035007, 30 pp. doi: 10.1088/0266-5611/31/3/035007
![]() |
[17] |
D. Zhang, Y. Guo, J. Li and H. Liu, Retrieval of acoustic sources from multi-frequency phaseless data, Inverse Problems, 34 (2018), 094001, 21 pp. doi: 10.1088/1361-6420/aaccda
![]() |
[18] |
Locating multiple multipolar acoustic sources using the direct sampling method. Commun. Comput. Phys. (2019) 25: 1328-1356. ![]() |
[19] | Unique determinations in inverse scattering problems with phaseless near-field measurements. Inverse Problems and Imaging (2020) 14: 569-582. |
[20] | Make Human Community: Open Source tool for making 3D characters, Available from: http://www.makehumancommunity.org. |
Algorithm Ⅰ: Geometric body shape regeneration scheme |
Step 1 Select the parameters |
Step 2 For the given |
Step 3 Use the training dataset |
Step 4 For a new characteristic set |
Step 5 Compute the Fourier coefficients |
Step 6 Select the sampling mesh |
Algorithm Ⅰ: Geometric body shape regeneration scheme |
Step 1 Select the parameters |
Step 2 For the given |
Step 3 Use the training dataset |
Step 4 For a new characteristic set |
Step 5 Compute the Fourier coefficients |
Step 6 Select the sampling mesh |