Research article Special Issues

An inverse scattering approach for geometric body generation: a machine learning perspective

  • In this paper, we are concerned with the 2D and 3D geometric shape generation by prescribing a set of characteristic values of a specific geometric body. One of the major motivations of our study is the 3D human body generation in various applications. We develop a novel method that can generate the desired body with customized characteristic values. The proposed method follows a machine-learning flavour that generates the inferred geometric body with the input characteristic parameters from a training dataset. The training dataset consists of some preprocessed body shapes associated with appropriately sampled characteristic parameters. One of the critical ingredients and novelties of our method is the borrowing of inverse scattering techniques in the theory of wave propagation to the body generation. This is done by establishing a delicate one-to-one correspondence between a geometric body and the far-field pattern of a source scattering problem. It enables us to establish the one-to-one correspondence between the geometric body space and the function space defined by the far-field patterns. Hence, the far-field patterns can act as the shape generators. The shape generation with prescribed characteristic parameters is achieved by first manipulating the shape generators and then reconstructing the corresponding geometric body from the obtained shape generator by a stable multiple-frequency Fourier method. The proposed method is in sharp difference from the existing methodologies in the literature, which usually treat the human body as a suitable Riemannian manifold and the generation is based on non-Euclidean approximation and interpolation. Our method is easy to implement and produces more efficient and stable body generations. We provide both theoretical analysis and extensive numerical experiments for the proposed method. The main goal of the study is to introduce inverse scattering approaches in combination with machine learning to the geometric body generation and it opens up many opportunities for further developments.

    Citation: Jinghong Li, Hongyu Liu, Wing-Yan Tsui, Xianchao Wang. An inverse scattering approach for geometric body generation: a machine learning perspective[J]. Mathematics in Engineering, 2019, 1(4): 800-823. doi: 10.3934/mine.2019.4.800

    Related Papers:

    [1] Giuseppe Procopio, Massimiliano Giona . Bitensorial formulation of the singularity method for Stokes flows. Mathematics in Engineering, 2023, 5(2): 1-34. doi: 10.3934/mine.2023046
    [2] Francesco Maddalena, Danilo Percivale, Franco Tomarelli . Signorini problem as a variational limit of obstacle problems in nonlinear elasticity. Mathematics in Engineering, 2024, 6(2): 261-304. doi: 10.3934/mine.2024012
    [3] Alessandro Michelangeli, Raffaele Scandone . On real resonances for three-dimensional Schrödinger operators with point interactions. Mathematics in Engineering, 2021, 3(2): 1-14. doi: 10.3934/mine.2021017
    [4] Siddhartha Mishra . A machine learning framework for data driven acceleration of computations of differential equations. Mathematics in Engineering, 2019, 1(1): 118-146. doi: 10.3934/Mine.2018.1.118
    [5] Giorgia Franchini, Valeria Ruggiero, Federica Porta, Luca Zanni . Neural architecture search via standard machine learning methodologies. Mathematics in Engineering, 2023, 5(1): 1-21. doi: 10.3934/mine.2023012
    [6] Alemdar Hasanov, Alexandre Kawano, Onur Baysal . Reconstruction of shear force in Atomic Force Microscopy from measured displacement of the cone-shaped cantilever tip. Mathematics in Engineering, 2024, 6(1): 137-154. doi: 10.3934/mine.2024006
    [7] Tommaso Tassi, Alberto Zingaro, Luca Dede' . A machine learning approach to enhance the SUPG stabilization method for advection-dominated differential problems. Mathematics in Engineering, 2023, 5(2): 1-26. doi: 10.3934/mine.2023032
    [8] Raimondo Penta, Ariel Ramírez-Torres, José Merodio, Reinaldo Rodríguez-Ramos . Effective governing equations for heterogenous porous media subject to inhomogeneous body forces. Mathematics in Engineering, 2021, 3(4): 1-17. doi: 10.3934/mine.2021033
    [9] Ansgar Jüngel, Ulisse Stefanelli, Lara Trussardi . A minimizing-movements approach to GENERIC systems. Mathematics in Engineering, 2022, 4(1): 1-18. doi: 10.3934/mine.2022005
    [10] Sudarshan Tiwari, Axel Klar, Giovanni Russo . Interaction of rigid body motion and rarefied gas dynamics based on the BGK model. Mathematics in Engineering, 2020, 2(2): 203-229. doi: 10.3934/mine.2020010
  • In this paper, we are concerned with the 2D and 3D geometric shape generation by prescribing a set of characteristic values of a specific geometric body. One of the major motivations of our study is the 3D human body generation in various applications. We develop a novel method that can generate the desired body with customized characteristic values. The proposed method follows a machine-learning flavour that generates the inferred geometric body with the input characteristic parameters from a training dataset. The training dataset consists of some preprocessed body shapes associated with appropriately sampled characteristic parameters. One of the critical ingredients and novelties of our method is the borrowing of inverse scattering techniques in the theory of wave propagation to the body generation. This is done by establishing a delicate one-to-one correspondence between a geometric body and the far-field pattern of a source scattering problem. It enables us to establish the one-to-one correspondence between the geometric body space and the function space defined by the far-field patterns. Hence, the far-field patterns can act as the shape generators. The shape generation with prescribed characteristic parameters is achieved by first manipulating the shape generators and then reconstructing the corresponding geometric body from the obtained shape generator by a stable multiple-frequency Fourier method. The proposed method is in sharp difference from the existing methodologies in the literature, which usually treat the human body as a suitable Riemannian manifold and the generation is based on non-Euclidean approximation and interpolation. Our method is easy to implement and produces more efficient and stable body generations. We provide both theoretical analysis and extensive numerical experiments for the proposed method. The main goal of the study is to introduce inverse scattering approaches in combination with machine learning to the geometric body generation and it opens up many opportunities for further developments.


    With the rapid technological advancement today, the access to realistic 3D human shapes is of great importance in both computer vision and graphics, and has various applications in different industries including virtual game design, film making, bioinformatics[41], healthcare[38], and especially, those related to garment design. Some applications involve fitting predictions, virtual try-on simulations[13,16,23,34] or size recommendations[5,6,7], that help to recommend relevant clothing which would fit specific occasions or fashion trends for online customers. Such applications require a critical ingredient on digital transformation from humans bodies to digital 3D shapes, such that the shapes maintain some of the main features from human bodies.

    The traditional approaches to access reliable digital information of a human body are through laser range scanners[1], stereo reconstruction[18,22,33] or structured light methods for 3D sensing[11,20,24]. However, considering the cost of data storage, network transmission and expensive scanning equipment, it is rather unpractical to scan individuals for each application. Hence many studies have been done to generate 3D human shapes based on partial input information. These prior systems can be mainly classified into three types: marker-based systems, silhouette-based systems and measurement-based systems. Marker-based system estimates dynamic 3D human body shapes by capturing a sparse set of marker positions. These techneqiues proceed by using a single static scan or multiple scans and a marker motion capture sequence of the person[4]. For the static case, silhouette-based system estimates human body shapes based on a set of input images by fitting the silhouette in each view [3,8,9,15]. Some apporaches also combine with machine learning that build a correlation between a training dataset of 3D body shapes and a set of 2D images, and then predict a shape based on the correlation[14].

    Although marker-based systems and silhouette-based systems could yield satisfactory reconstructions on 3D human body shapes under tight dresses or naked human shapes, most of the schemes are so computationally expensive and the results are easily affected if heavy or loose clothes are worn. To overcome these difficulties, a great deal of efforts have been devoted to the investigation of simple and fast measurement-based systems [17,32,35]. Typically, one considers the landmarks or circumferences from the human structures at specific locations as characteristic values. Since such characteristic values are linear or curvilinear, they are relatively invariant to articulation changes than those silhouettes measurements. If the set of characteristic values is well selected, one can achieve meaningful estimation for both global and local body shapes. Kart et al. (2011) built a system which only requires to input some personal information, such as weight, height and age as well as a 2D photograph. The decision algorithm then determines the human shape according to the measurements and the body mass index (BMI)[12]. Seo et al. [35] presented a human body generation apporach by taking the anthropometric measurements, e.g., stature, crotch length, arm length, neck girth, chest/bust girth, underbust girth, waist girth and hip girth as input. They derived the relationship between the input characteristic values and the preprocessing database of 3D scanned data of human body models by using radial basis interpolation. At run-time, the system generates new human body shapes from the user input characteristic values by fitting the template model onto each scanned data.

    In this paper, we develop a completely novel methodology for the geometric body generation, which fulfils the following two basic requirements: (ⅰ) the geometric body generation is automatically determined by the input characteristic sets; (ⅱ) the predicted geometric shape fits for all input characteristic values and moreover it can well approximate the exact geometric body possessing the aforesaid characteristic values. The proposed method follows a machine-learning flavour that generates the inferred geometric body with the customized characteristic parameters from a training dataset. The training dataset consists of some preprocessed body shapes associated with appropriately sampled characteristic parameters. One of the critical ingredients and novelties of our method is the borrowing of inverse scattering techniques in the theory of wave propagation to the body generation. This is done by establishing a delicate one-to-one correspondence between a geometric body and the far-field pattern of a source scattering problem governed by the Helmholtz system. It in turn enables us to establish a one-to-one correspondence between the geometric body space and the function space defined by the far-field patterns. Hence, the far-field patterns can act as the shape generators. The shape generation with prescribed characteristic parameters is achieved by first manipulating the shape generators in the function space and then reconstructing the corresponding geometric body from the obtained shape generator by a stable multiple-frequency Fourier method. The proposed method is in sharp difference from the existing methodologies in the literature, which usually treat the human body as a suitable Riemannian manifold and the generation is based on non-Euclidean approximation and interpolation. In fact, in all of the literature mentioned earlier on manifold learning of body generation, one typically uses Principal Component Analysis (PCA) or Principal Geodesic Analysis (PGA). PCA and PGA are used for optimal reduction of the data and thus efficient deformation by computing statistics on Euclidean manifolds or non-Euclidean manifolds can be achieved; see [35,10] and the references therein for more relevant discussion. In our new approach, the shape generator enables us to train the learning dataset via the algebraic operations in the shape space directly without dealing with the deformation of the manifold meshes between geometric shapes.

    The rest of the paper is organized as follows. In section 2, we provide rigorous mathematical formulations of characteristic values and shape space. Section 3 introduces the notion of shape generator via the inverse source scattering associated with the Helmholtz system. In section 4, we present the mathematical setup of the geometric body generation from a machine-learning perspective. Section 5 is devoted to the development of the new method for the shape generation. In section 6, we present several two- and three-dimensional numerical examples to show the effectiveness and efficiency of our method. The paper is concluded in section 7 with some relevant discussion.

    In this section, we present some preliminary knowledge on the shape manifold theory that shall be needed in our subsequent study of body generation. Generally speaking, a geometric shape or a geometric body is a topological n -manifold, nN , equipped with certain shape descriptors, which give the full information to describe the geometric shape. We call such shape descriptors as characteristic values. We have the following formal definition.

    Definition 2.1. Let D be a topological n -manifold with nN . Let ΛD:={λ(j)}jC be a set of parameters associated with D that are invariant with respect to isometric deformations and are independent to the parametrizations of D . Here, the cardinality C might be finite or infinite. ΛD is said to be a characteristic set of D if it uniquely determines D . D and its characteristic set ΛD , written as the (D,ΛD) is referred to as a geometric shape or a geometric body.

    Clearly, Definition 2.1 includes much general geometric objects. However, for the present study, we are mainly concerned with the case that D can be embedded into Rd , d=2,3 , as a bounded domain. That means, we exclude some interesting cases such as D is a Riemannian surface with boundary in R3 . Nevertheless, our study is general enough to include the human body as a specific case.

    In Definition 2.1, the set of characteristic values is typically a set of measurements which gives a systematic characterization of the size, shape and composition of a geometric object for us to determine the shape of the object. For example, when considering a rectangular object, once can introduce a set of characteristic values containing its height, width and length, which provide all details to determine a unique rectangular shape. Expanding the same idea to human body shapes, one could also use characteristic sets to represent them. There are many different ways to represent a human shape. We would try to group those characteristic values into four main catagories, including Eucidean distance, geodesic distance, circumference and ratio. The Eucidean or geodisic distance is linear or curvilinear distance between two points on the human model, such as stature, crotch length, arm length, shoulder breadth etc. The circumference can be computed by the horizontal girth of the body, such as neck girth, chest/bust girth, under-bust girth, waist girth, hip girth, etc. The ratio can be information of weight, Body Mass Index, muscle and fat rate. In spite of the above characteristic values, one can also consider some pure measurements such as age or gender as characteristic values.

    The full set of characteristic values gives the complete information of a geometric shape without lossing any information. It is easy to imagine that the cardinality of a set of characteristic values depends on the complexity of a shape. Hence, the number of characteristic values required can be considered as the dimensionality of the geometric shape. For those complicated objects, like human shapes, it may require infinite set of characteristic values for accurate formulations. Due to practical reasons, one can consider a reasonable truncation of an infinite characteristic set into a finite one for a complicated geometric shape. In doing so, we can consider our study in the following product space

    S:=D×V, (2.1)

    where D is composed of all the bounded domains in Rd and V is an M -dimensional vector space containing the characteristic values. In fact, in the present study, the characteristic values are usually real numbers and one can take V=RM with MN . S is referred to as the geometric shape space. According to the (approximate) one-to-one correspondence between a geometric shape and its characteristic values in Definition 2.1, we readily see that all the shape information can be obtained by a single point of this M -dimensional vector space V . By adjusting the characteristic values, we can obtain new geometric shapes and this is a key ingredient in our human body interpolation.

    In the previous section, we introduce the important notion of shape space for our study. We proceed to introduce another critical ingredient, shape generator, for our subsequent study of the geometric body generation. In fact, the generation of a new geometric shape shall be based on algebraic interpolation of exemplar models from the shape space. If the algebraic operations are to be conducted directly in the shape space, dealing with geometric deformations of manifolds, one would certainly encounter very complicated and tedious calculations and manipulations because of the lack of global parametrizations for the non-Eucidean shapes involved. The shape generator can overcome this challenge by bridging the geometric shape space and the function space. To that end, we next introduce the inverse scattering problem in finding an active source from its generated far-field pattern.

    Let f:RdC be a function having a compact support, f=χDφ , where DRd is a bounded domain and φL(Rd) . The set D is the external shape of f while φ describes the intensity of the source at various points in D . We assume that φ and D do not depend on the wavenumber kR+ . In other words we are considering monochomatic scattering. The source f produces a scattered wave uH2loc(Rd) given by the unique solution to

    (Δ+k2)u=f,limrrd12(rik)u=0, (3.1)

    where r=|x| for xRd . The limit in (3.1) is known as the Sommerfeld radiation condition which characterizes the outgoing nature of the radiating wave. By the limiting absorption principle (cf. [21]), the solution to (3.1) can be computed as follows,

    u=(Δ+k2)1f=limε+0(Δ+(kiε)2)1f=limε+0Rdeixξˆf(ξ)|ξ|2(kiε)2 dξ, (3.2)

    where

    ˆf(ξ):=Ff(ξ)=(2π)dRnf(x)eiξx dx (3.3)

    signifies the Fourier transform of f . Inverting the Fourier transform in (3.2), one has the following integral representation,

    u=(Δ+k2)1f:=i4(k2π)d22Rd|xy|2d2H(1)d22(k|xy|)f(y) dy, (3.4)

    where H(1)(d2)/2 is the first-kind Hankel function of order (d2)/2 . Stationary phase applied to (3.4) yields that

    u(x)=eik|x||x|(d1)/2Cd,kRdeikˆxyf(y) dy+O(|x|d2),|x|, (3.5)

    where ˆx:=x/|x|Sd1 , xRd{0} , and

    Cd,k=i8π(k2π)d22e(d1)π4i.

    The far-field pattern of u is given by

    u(ˆx,k;f):=Cd,kRdeikˆxyf(y) dy=(2π)dCd,kFf(kˆx)L2(Sd1). (3.6)

    It is obvious that u is (real) analytic in both ˆx and k . Hence, if u(ˆx,k) is known on any open portion of Sd1×R+ , then it is known on the whole set by analytic continuation.

    The inverse source scattering problem is concerned with the recovery of f=φχD by knowledge of u(ˆx,k;f) for (ˆx,k)Σ , where Σ is an open subset of Sd1×R+ . According to our discussion above, without loss of generality, we always assume that Σ=Sd1×R+ in what follows. The inverse source problem arises in a variety of important applications including detection of hazardous chemicals, medical imaging, photoacoustic and thermoacoustic tomography, brain imaging, artificial intelligence in gesture computing and others. We refer to the recent articles [25,26,39,40] by two of the authors of this article for some recent developments on the inverse source problem.

    Next, let us consider a specific case by assuming a source supported in a domain D with a constant density 1 . Then clearly by (3.6), there is a one-to-one correspondence between D and u(Σ;D):={u(ˆx,k;1χD)}(ˆx,k)ΣL2(Sd1×R+) in the sense that for two domains D1 and D2 ,

    u(Σ;D1)=u(Σ;D2)if and only ifD1=D2. (3.7)

    Based on (3.7), we next introduce

    Definition 3.1. For a geometric shape (D,ΛD)S ,

    u(Σ;D):={u(ˆx,k;1χD)}(ˆx,k)ΣL2(Sd1×R+)

    defined via the Helmholtz system (3.1) is called a shape generator for D .

    Remark 3.1. By Definition 3.1, a geometric body D can be completely determined by a shape generator u(Σ) . Since u(Σ) is from a function space, this paves the way for the new body generation through function interpolations.

    Remark 3.2. By (3.6), we know the far-field pattern is actually the Fourier transform of the source density up a dimensional constant. However, introducing the shape generator via the inverse scattering approach shall provide more physical insights in our study, and moreover it enables us to borrow ideas from the inverse scattering literature of recovering the geometric shape D from the associated far-field pattern. This also paves the way of extending the idea by using other inverse scattering models that have such one-to-one correspondence between geometric shapes and far-field patterns; see more relevant discussion in section 7.

    In this section, we introduce the mathematical formulation of the geometric body generation for our study from a machine learning perspective. For a geometric shape (D,ΛD) with the associated shape generator u(Σ;D) , the pair of the high dimensional variables, written as {(ΛD,u(Σ;D))} , is referred to as an input-output pair. Let {(ΛDi,u(Σ;Di))}iN with N={0,1,,Npair} be a set of input-output pairs associated with the characteristic sets {ΛDi}iN . Here the input characteristic sets ΛDi are introduced as

    ΛDi:={λ(j)i}jC,iN, (4.1)

    with C={1,,M} . In (4.1), the notation λ(j)i represents the characteristic value of the i -th geometric shape Di in the j -th direction of its characteristic set. Here, the cardinality N is finite. The training dataset of the geometric body generation is introduced to be

    Z:={(ΛDi,u(Σ;Di))}iN (4.2)

    with

    Λ=(λ(1),,λ(M))RM and u(Σ)L2(Sd1×R+). (4.3)

    The training dataset consists of certain pre-sampled geometric shapes with statistically well selected characteristic values. The corresponding shape generator of a specific body in the training dataset can also be pre-calculated and stored. The main goal of our study is to first infer a learning model from the training dataset, TZ:RML2(Sd1×R+) that fulfils the following requirements:

    1. It fits the training data well in the sense that

    TZ(ΛDi):=ˆu(Σ;Di)u(Σ;Di),DiZ. (4.4)

    2. It can be used to infer the shape generator for a given new shape with prescribed characteristic values, namely,

    ˆu(Σ;Dnew):=TZ(ΛDnew), (4.5)

    and with a statically well selected training dataset, it is justifiable to expect that

    ˆu(Σ;Dnew)u(Σ;Dnew), (4.6)

    where u(Σ;Dnew) is the shape generator for Dnew .

    If a learning model can be achieved that fulfils the two requirements as described above, then the body generation can be proceeded as follows. For a given new set of characteristic values, one first generates the learned shape generator as in (4.5). By a certain inverse scattering approach, one can then reconstruct the (approximate) shape Dnew from the corresponding shape generator ˆu(Σ;Dnew) . In the next section, we shall develop the two critical ingredients in the body generation procedure described above, namely, the learning model and the reconstruction method. To be more definite and specific, we first introduce the following definition from a machine learning perspective.

    Definition 4.1. (Body learning model) Given a training dataset

    Z:={(ΛDi,u(Σ;Di))}iN. (4.7)

    Let H be a compact subset of L2(Sd1×R+) . TZH (with specified coefficients C ) is said to be the best fit learning model associated with the training dataset Z if it is the minimizer of the following optimization problem,

    minTZH1Npair+1iNTZ(ΛDi)u(Σ;Di)2H. (4.8)

    According to Definition 4.1, the choice of the learning subspace H plays a critical role. However, we note that the shape generator is actually (real) analytic in all of its arguments. Hence, instead of solving the computationally costly optimization problem (4.8), we can make use of the functional interpolation to produce a well-rounded shape learning model. This is one of the main advantages of introducing the shape generator through the inverse scattering model. In the next section, for a given training dataset as in (4.7), we shall derive a learning model using the cubic B-spline interpolation through the use of the high-dimensional data-points (4.4). For the reconstruction of the approximate body shape from the shape generator obtained through the learning model, we shall make use of a multiple-frequency Fourier method, and it can also produce an efficient and stable recovery. Throughout, we assume that the characteristic values in the training dataset is statistically well selected and it is not the focus of the present article.

    In this section, we develop the details of our scheme for the geometric body generation following the general discussion made in the previous section. We first derive the learning model through the functional interpolation of the high-dimensional data in the training dataset. To that end, we present some preliminary knowledge on the cubic B-spline, and we also refer to [2,19,36,37] for more relevant discussion on the cubic B-spline.

    Consider the training dataset (4.2). Let the M sets of unique grids in the directions of {λ(j)}jC

    Δj={λ(j)0,,λ(j)kj}jC,kjN, (5.1)

    define on the intervals [aj,bj] as M sets of points λ(j)gj[aj,bj]R , where gj{0,,kj} and aj=λ(j)0<λ(j)1<<λ(j)kj=bj,j=1,,M . Here, kj is the greatest number of distinct characteristic values in the j -th direction of the characteristic set. We remark that if the characteristic values of the training dataset are all collected in distinct values, then kj is actually the last index of the training dataset, Npair . However, the training dataset might be collected in such a way that some body shapes may possess the same characteristic value in the j -th direction, and hence kj is usually smaller than Npair .

    With the above notation, the training dataset stored as the array in (4.2) can be represented as elements on the grid mesh corresponding to the characteristic numbers λ(j) as described above. The interpolation data are the corresponding shape generators and are written as

    u(Σ;Di):=Ug1,g2,,gML2(Sd1×R+),iN, (5.2)

    where gj=0,,kj,j=1,,M. In the subsequent study, we shall stick to the same notation g1,g2,,gM to represent the linear indexing. The following example demonstrates a real application for the human body generation.

    Example 5.1. The training dataset consists of 20 bodies with two characteristic values as consideration, say, height and relative weight. Here, the height and relative weight are the two directions of the grids, λ(height) and λ(weight) . Suppose the heights of the sampled bodies are given by 1.5 m, 1.6 m, 1.7 m, 1.8 m, 1.9 m and the relative weights of the sampled bodies are given by 60%, 80%, 100%, 120%. Then the first grid Δheight={λ(height)0,λ(height)1,λ(height)2,λ(height)3,λ(height)4}={1.5,1.6,1.7,1.8,1.9} and the second grid Δweight={λ(weight)0,λ(weight)1,λ(weight)2,λ(weight)3}={0.6,0.8,1,1.2} . The interpolation data are actually stored as listed in Table 1; e.g., U0,0=u(Σ;D1),U0,3=u(Σ;D4),U1,3=u(Σ;D8) .

    Table 1.  Training dataset with the given characteristic grids (λ(height),λ(weight)).
    2nd grid
    λ(weight)0 λ(weight)1 λ(weight)2 λ(weight)3
    λ(height)0 (ΛD1,u(Σ,D1))
    =(1.5,0.6,U0,0)
    (ΛD2,u(Σ,D2))
    =(1.5,0.8,U0,1)
    (ΛD3,u(Σ,D3))
    =(1.5,1,U0,2)
    (ΛD4,u(Σ,D4))
    =(1.5,1.2,U0,3)
    1st gridλ(height)1 (ΛD5,u(Σ,D5))
    =(1.6,0.6,U1,0)
    (ΛD6,u(Σ,D6))
    =(1.6,0.8,U1,1)
    (ΛD7,u(Σ,D7))
    =(1.6,1,U1,2)
    (ΛD8,u(Σ,D8))
    =(1.6,1.2,U1,3)
    λ(height)2 (ΛD9,u(Σ,D9))
    =(1.7,0.6,U2,0)
    (ΛD10,u(Σ,D10))
    =(1.7,0.8,U2,1)
    (ΛD11,u(Σ,D11))
    =(1.7,1,U2,2)
    (ΛD12,u(Σ,D12))
    =(1.7,1.2,U2,3)
    λ(height)3 (ΛD13,u(Σ,D13))
    =(1.8,0.6,U3,0)
    (ΛD14,u(Σ,D14))
    =(1.8,0.8,U3,1)
    (ΛD15,u(Σ,D15))
    =(1.8,1,U3,2)
    (ΛD16,u(Σ,D16))
    =(1.8,1.2,U3,3)
    λ(height)4 (ΛD17,u(Σ,D17))
    =(1.9,0.6,U4,0)
    (ΛD18,u(Σ,D18))
    =(1.9,0.8,U4,1)
    (ΛD19,u(Σ,D19))
    =(1.9,1,U4,2)
    (ΛD20,u(Σ,D20))
    =(1.9,1.2,U4,3)

     | Show Table
    DownLoad: CSV

    Let S3(Δj),j=1,,M be a function subspace of C2([aj,bj]) consisting of one dimensional, complex-valued functions in the direction of λ(j),j=1,,M on the bounded interval [aj,bj] . The function in S3(Δj),j=1,,M is piecewise polynomial of degree 3 on every subinterval [λ(l)gj1,λ(j)gj] , where gj=1,,kj,j=1,,M . Then we introduce a function subspace of multidimensional and complex-valued C2([aj,bj]) functions as

    S3(Δ1,,ΔM), (5.3)

    on each rectangular grid

    Ig1,g2,,gM:=jC[λ(j)gj,λ(j)gj+1] (5.4)

    for all 0gjkj1,j=1,,M that are piecewise polynomials of degree 3 on every interval. For easy reference we provide the definition of B-splines.

    Definition 5.1. The sets of kj+k,j=1,,M , B-spline basis functions {Bl,k(λ(j))}kj+kl=1 of degree k of the function space Sk(Δj) are defined based on concurrent boundary knots vectors with Cox-deBoor recurrence[19],

    Bl,k(λ(j))=λ(j)λ(j)l1kλ(j)l1λ(j)l1kBl1,k1(λ(j))+λ(j)lλ(j)λ(j)lλ(j)lkBl,k1(λ(j)) (5.5)

    with

    Bl,0(λ(j))={1if λ(j)lλ(j)<λ(j)l+10else, (5.6)

    for l=1,,kj+k , where k=3 is for the cubic B-spline and λ(j)l are elements of the knot vectors, satisfying the relation λ(j)l<λ(j)l+1 .

    All methods are in the following using splines with a k+1 regular knot vector, and the interior knots are the grid points. Based on Definition 5.1, we next introduce a general learning model for the geometric shape generation through the multidimensional cubic B-spline interpolation.

    Body learning model Ⅰ. Given the training dataset Z:={(ΛDi,u(Σ;Di))}iN , the learning model TZS3(Δ1,,ΔM) at Λ=(λ(1),,λ(M)) for the geometric body generation associated with the sets of the grids {Δj}jC is defined as follows

    TZ(Λ)=k1+3g1=1kM+3gM=1cg1,g2,,gMjCBjgj,3(λ(j)),λ(j)[aj,bj], (5.7)

    which satisfies the following conditions by (4.4)

    TZ(ΛDi)=k1+3g1=1kM+3gM=1cg1,g2,,gMjCBjgj,3(λ(j)i)=u(Σ;Di), (5.8)

    where cg1,g2,,gM with gj=0,,kj,j=1,,M are the coefficients to be determined from the training dataset Z , Bjgj,3(λ(j)),jC are the B-spline basis functions of degree 3 defined in (5.5), and kj,j=1,,M is the number of different characteristic values in each direction.

    Remark 5.1. In learning model Ⅰ, (5.7) presents a general form of the learning model TZ for the geometric body generation associated with the non-uniform grids {Δj}jC . The learning model eventually generates a B-spline interpolation with the associated spacing for each segment. If the training dataset consists of equidistant grids, we can derive a faster and easier learning model and this shall be provided in the next subsection.

    In this subsection, we derive a learning model for a special case with the training dataset consisting of equidistant grids. By (5.1), for the M set of equidistant grids Δj={λ(j)0,,λ(j)kj}jC with additional conditions

    λ(j)gj=aj+gjhj,hj=bjajkj,,gj=1,,kj, (5.9)

    the B-spline basis function βk(t) of degree k is a symmetrical, bell-shaped function constructed from k+1 times self-convolution of the β0(t) basis function of degree zero which is a centered rectangle around origin [37]

    β0(t)={1,12<t<1212,|x|=120,otherwise, (5.10)
    βk(t)=β0(t)β0(t)(k+1) times. (5.11)

    The centered symmetric B-spline of degree k has an explicit expression [36]

    βk(t)=1k!k+1j=0Ck+1j(1)j(t+k+12j)k+, (5.12)

    where the function x+ is defined as follows

    x+={x,forx>0,0,otherwise. (5.13)

    In this paper, we are particular intereted in the cubic B-spline. By (5.12), the closed-form representation of the cubic B-spline basis function can be also expressed as

    β3(t)=16{(2|t|)31<|t|2,46|t|2+3|t|3,|t|1,0,elsewhere, (5.14)

    which is used for preforming the interpolation. Then we choose the interpolation kernels to be

    Lgj(λ(j))=β3(λ(j)),kj=1,,Npair+3, (5.15)

    as the basis of S3(Δj) in the λ(j) -direction such that L={L1,L2,,Lkj+3} is a basis of the (kj+3) -dimensional space S3(Δ) and hence, the basis of the jC(kj+3) -dimensional space S3(Δ1,,ΔM) in the directions of λ(1),,λ(M) is given by

    {Lg1Lg2LgM|gj{1,,Npair+3},jC}. (5.16)

    Based on (5.16), (5.1) and (5.9), we next introduce the learning model for the uniform case.

    Body learning model Ⅱ. Given the training dataset Z:={(ΛDi,u(Σ;Di))}iN , the learning model TZS3(Δ1,,ΔM) at Λ=(λ(1),,λ(M)) for the geometric body generation associated with the sets of equidistent grids {Δj}jC defined in (5.9) is defined as follows

    TZ(Λ)=k1+3g1=1kM+3gM=1cg1,g2,,gMjCLjgj(λ(j)), (5.17)

    which is required to satisfy the following conditions

    TZ(ΛDi)=k1+3g1=1kM+3gM=1cg1,g2,,gMjCLjgj(λ(j)i)=u(Σ;Di), (5.18)

    where cg1,g2,,gM with gj=0,,kj,j=1,,M. are the coefficients to be determined from the training dataset Z , Ljgj(λ(j)) are B-spline basis functions of degree 3 defined in (5.15) and kj,j=1,,M . is the number of different characteristic values in each direction.

    In learning models Ⅰ and Ⅱ, the learning functionals for the non-uniform and uniform case are respectively considered in the jC(kj+3) -dimensional space S3(Δ1,,ΔM) . jC(kj+3) interpolation conditions are required to determine the coefficients ci1,i2,,iM in the training models. However, there are only jC(kj+1) shape generators to specify jC(kj+1) conditions in (5.8) or (5.18). To obtain a unique correlation between the characteristic values and the shape generator, we need to add jC2=2M conditions, which define the second-order derivatives of the spline function at the boundary aj and bj to be equal to 0 and lead to a natural spline.

    With the learning models Ⅰ and Ⅱ established in the previous subsections, for an input new set of characteristic values ΛDnew associated with a new geometric body Dnew , the unknown shape generator can be generated as follows,

    TZ(ΛDnew)=k1+3g1=1kM+3gM=1cg1,g2,,gMjCLjgj(λ(j)new)=ˆu(Σ;Dnew)u(Σ;Dnew), (5.19)

    where the coefficients cg1,g2,,gM in (5.19) could be determined by solving the natural spline problem.

    In this subsection, we briefly outline the Fourier method for the reconstruction of geometry shape Dnew by using the shape generators u(Σ;Dnew) .

    Define the periodic Sobolev space by

    Hσ(Rd)={gL2(Rd):(1+|ξ|2)σ2ˆg(ξ)L2(Rd),},

    where σ1 , ξZd and ˆg(ξ) denote the Fourier coefficients of g . Suppose that fHσ(Rd) has a compact support in domain V0=(a/2,a/2)d,(a>0) , then the Fourier transform of f is represented by

    ˆfξ=1adV0f(x)¯ϕξ(x)dx, (5.20)

    where the overbar stands for the complex conjugate and the Fourier basis functions are given by

    ϕξ(x)=exp(i2πaξx),ξZd.

    Definition 5.2 (Admissible wavenumbers and observation directions). Let μ be a sufficiently small positive constant such that 0<μ<1 and

    ξ0:={(μ,0),d=2,(μ,0,0),d=3,

    then the admissible set of wavenumbers is defined by

    K:={2πa|ξ|:ξZ3{0}}k0,

    correspondingly, the admissiable set of observation directions is given by

    X:={ξ|ξ|:ξZ3{0}}ˆx0,

    where k0=2π|ξ0|/a and ˆx0=ξ0/|ξ0| for ξ=0Zd .

    Due to suppS⊂⊂V0 , for ξZ3{0} , the far-field pattern defined in (3.6) can be written as

    u(ˆx,k;f)=Cd,kRdeikˆxyf(y) dy=Cd,kV0eikˆxyf(y) dy, (5.21)

    where kK and ˆxX depend on ξ . Combining (5.20) and (5.21), one has

    ˆfξ=1adCd,ku(ˆx,k;f),ξZ3{0}. (5.22)

    For ξ=0 , using the Fourier expansion of f , we derive that

    u(ˆx0,k0;f)=Cd,kV0eik0ˆx0yf(y) dy,=Cd,kV0(ˆf0+ξZd{0}ˆfξϕξ)¯ϕξ0(y) dy=Cd,kV0ˆf0¯ϕξ0(y) dy+Cd,kξZd{0}ˆfξV0ϕξ(y)¯ϕξ0(y) dy=adCd,ksin(μπ)μπˆf0+Cd,kξZd{0}ˆfξV0ϕξ(y)¯ϕξ0(y) dy,

    which implies

    ˆf0=μπadsinμπ{u(ˆx0,k0;f)Cd,kξZ3{0}ˆfξV0ϕξ(y)¯ϕξ0(y) dy}. (5.23)

    Therefore, the Fourier method is to approximate f by a truncated Fourier expansion

    fN=ˆf0+1|ξ|Nˆfξϕξ,

    where NN+ denotes the truncation order and the Fourier coefficients are given by (5.22) and (5.23). Hence the domain Dnew is determined since the set Dnew is the external shape of f .

    Next, we investigate the stability of the proposed Fourier method. In practical computation, there exists some noise between the shape generators u(Σ;Dnew) and the predictions ˆu(Σ;Dnew) , which satisfies

    ˆu(Σ;Dnew)u(Σ;Dnew)L2δu(Σ;Dnew)L2,

    where δ>0 denotes the noise level. Noting that (ˆx,k)X×KΣ , then the approximation of f from predicted shape generators is given by

    fδN=ˆfδ0+1|ξ|Nˆfδξϕξ,

    where

    ˆfδξ=1adCd,kˆu(ˆx,k),ξZ3{0}, (5.24)
    ˆfδ0=μπadsinμπ{ˆu(ˆx0,k0)Cd,kξZ3{0}ˆfδξV0ϕξ(y)¯ϕξ0(y) dy}. (5.25)

    Theorem 5.1. Let f be a compactly supported function in Hσ(Rd) , σ1 , with suppf⊂⊂V0 , then we have the following estimate

    fδf2L2(V0)Cδ+C(τd+τ2)δ42+d.

    where dτR+ and C is a constant which depends on f,a,d,μ .

    Proof. Using the Plancherel theorem, we have

    fδf2L2(D)=fδf2L2(Rd)=1a2dRd|ˆfδξˆfξ|2 dξ=1a2d(|ξ|N|ˆfδξˆfξ|2 dξ+|ξ|>N|ˆfδξˆfξ|2 dξ), (5.26)

    where NN+ . Due to fHσ(Rd) , that is,

    (1+|ξ|2)α2ˆfξL2(Rd),|α|σ.

    It means that both |ξ|ˆfξ and |ξ|ˆfδξ are bounded in L2(Rd) , so we can find N>0 , such that

    |ξ|>N|ˆfδξˆfξ|2 dξ1N2|ξ|>N|ξ|2|ˆfδξˆfξ|2 dξ<C1N2, (5.27)

    where C1>0 is a constant. For 1|ξ|N , from (5.22) and (5.24), we have

    |ˆfδξˆfξ|=1adCd,k|ˆu(ˆx,k)u(ˆx,k)|δadCd,k|u(ˆx,k)|=δadCd,k|Cd,kV0f(y)eikˆxy dy|δad(V0|f(y)|2 dy)12(V0|eikˆxy|2dy)12=fL2(V0)ad/2δ,

    which implies

    1|ξ|N|ˆfδξˆfξ|2 dξC2(2N+1)dδ2, (5.28)

    for C2=f2L2(V0)/ad . Define ξ=(ξ1,ξ2)Z2 or ξ=(ξ1,ξ2,ξ3)Z3 , by a straight forward calculation, one finds that

    V0ϕξ(y)¯ϕξ0(y) dy={0,|ξ||ξ1|,adcosξ1πsinλπ(ξ1λ)π,|ξ|=|ξ1|.

    For ξ=0 , using (5.23), (5.25), (5.27), (5.28) and the last equation, it derives that

    |ˆfδ0ˆf0|μπadCd,ksinμπ|ˆuδ(ˆx0,k0)uδ(ˆx0,k0)|+μπadsinμπ1|ξ|N|ˆfδξˆfξ||V0ϕξ(y)¯ϕξ0(y) dy|+μπadsinμπ|ξ|N|ˆfδξˆfξ||V0ϕξ(x)¯ϕξ0(x) dy|C3δ+C2(2N+1)dδ+C1N, (5.29)

    where C3=μπfL2(V0)/(ad/2sinμπ) . Hence, substituting (5.27), (5.28) and (5.29) into (5.26), it deduces that

    fδf2L2(V0)Cδ2+CNdδ2+CN2,

    where C=max{2C1,2d+1C2,C23}/a2d . Furthermore, if we take N=τδ22+d with τd in Theorem 5.1, then it holds that

    fδf2L2(V0)Cδ+C(τd+τ2)δ42+d.

    Let N=[τδ22+d,τd] , here [X] denotes the largest integer that is smaller than X+1 . From definition 5, the truncated wavenumbers and observation directions can be written as

    KN:={2πa|ξ|:1|ξ|N}k0,XN:={ξ|ξ|:1|ξ|N}ˆx0.

    Thus, the truncated Fourier expansion of f from the predictions {ˆu(Σ;Dnewq)}qQ takes the form

    fδN:=ˆfδ0+1|ξ|Nˆfδξϕξ(x), (5.30)

    where

    ˆfδξ=1adCd,kˆu(ˆx,k),1|ξ|N,ˆfδ0=μπadsinμπ{ˆu(ˆx0,k0)Cd,k1|ξ|NˆfδξV0ϕξ(y)¯ϕξ0(y) dy}. (5.31)

    Motivated by above discussion, we are ready to present our novel modeling methodology for geometric shape in Rd,d=2,3 , see Algorithm 1.

    Algorithm 1: Inverse-scattering-based geometric body generation scheme
    1: Select the parameter N , the set of admissible wavenumbers KN and the set of admissible observation directions XN .
    2: Given a training dataset Z:={(ΛDi,u(ˆx,k;Di))}iN for ˆxXN,kKN , obtain the coefficients cg1,,gM of the learning model TZ by solving the problem of the natural spline interpolation.
    3: Given the characteristic sets ΛDnew , predict the new shape generators {ˆu(ˆx,k)} for ˆxXN,kKN with the use of the learning model TZ .
    4: Compute the Fourier coefficients ˆfδ0 and ˆfδξ defined in (5.31) for 1|ξ|Nt .
    5: Select a sampling mesh Th in a region V0 . For each sampling point zjT , calculate the imaging function fδN defined in (5.30). Dnew is obtained as the external shape of fδN .

     | Show Table
    DownLoad: CSV

    In this section, several numerical examples of geometric body generation are conducted to show that the proposed method is effective and efficient. Here the geometric body includes general geometric shape and human body shape.

    The proposed algorithm is implemented by using Matlab 2016. The shape generator {u(ˆx,k;Di)}iN is obtained by solving the direct problem of (3.1). To avoid the inverse crime, we use the quadratic finite elements on a truncated spherical domain enclosed by a PML layer. The mesh of the forward solver is successively refined till the relative error of the successive measured scattered data is below 0.1% . Then artificial shape generators are generated by applying the Kirchhoff integral formula to the scattered data. Thus the training dataset is given by

    {(ΛDi,u(ˆxj,kj;Di)):ˆxjXN,kjKN},

    where j=1,2,,(2N+1)d and i=1,2,,Nt denotes the i -th geometry shape. In what follows, we set τ=2 (τ=3 ) for d=2 (d=3 ) and δ=1% , then we have N=20 (N=19 ) for d=2 (d=3 ).

    Next, we present the implementation of interpolation. The characteristic value set is given by {ΛDi} , where ΛDi={λ(1)i,λ(2)i,,λ(M)i} has M variables. For a fixed wavenumber kj , we use cubic spline interpolation to obtain the coefficients ci1,iM from the characteristic value ΛDi and the shape generator u(ˆxj,kj;Di) . Therefore, given a new characteristic value ΛDnew={λ(1)Dnew,λ(2)Dnew,,λ(M)Dnew} , we obtain the predicted shape generators {ˆu(ˆxj,kj;Dnew)},j=1,2,,(2N+1)d .

    Finally, we specify details of recovering the geometry. As discussed above, reconstructing the geometry shape is equally to reconstructing the source function f . In the discrete formula, the domain V0 is divided into a uniform mesh with size 100×100 in two dimensions and size 100×100×100 in three dimensions. Further, the approximated Fourier series fδN are computed at the mesh nodes Tj,j=1,,1003 in (5.30). Thus, the geometry shape Dnew is approximated by the boundary of the imaging results fδN .

    In the first example, we aim to reconstruct a kite shaped domain with scale changing. The kite shaped domain is parameterized by

    x(t)=(β1(cost+0.65cos2t0.65), 1.5β2sint),t[0,2π],

    where β1 and β2 are scale factors (characteristic values) with β1,β2[0.5,1.8] . The training dataset consists of 14×14 different scale domains, i.e., β1 and β2 uniformly distributed on [0.5,1.8] with M=142 . Next, we consider four sets of different scale factors which are not covered by the training data. In this numerical experiments, the imaging results with different characteristic values are shown in Figure 1, where the black dotted lines denote the exact boundary. It is clear that the reconstructions are very closed to the exact domains.

    Figure 1.  Contour plots of reconstructed kite shape with different scale factors (β1,β2) : (a) (0.93,1.76) , (b) (1.58,0.87) , (c) (0.95,0.95) , (d) (1.65,1.65).

    In the second example, we aim to recover multi-domain with different scale factors. The apple shaped domain is parameterized by

    y(t)=β1((0.5+0.4cost+0.1sin2t)/(1+0.7cost))(cost, sint)t[0,2π],

    and the rounded triangle shaped domain is parameterized by

    z(t)=β2(1+0.15cos3t)(cost, sint)t[0,2π],

    where β1[1,2] and β2[0.5,1.5] are scale factors (characteristic values) for different domains. The training dataset consists of 11×11 different scale domains, that is, β1 and β2 uniformly distributed on [1,2]×[0.5,1] . Similarly, we give four sets of different scale factors which are not covered by the training data. Figure 2 shows the the reconstruction of multi-domain with different characteristic values via contour plots, where the black dotted lines denote the exact boundary. It demonstrates very good imaging performance of the approach.

    Figure 2.  Contour plots of reconstructed mixed shape with different scale factors (β1,β2) : (a) (1.13,1.13) , (b) (1.94,0.53) , (c) (1.88,0.94) , (d) (1.96,1.47).

    In the third example, we verify the proposed method by using a set of artificial experiments on rectangular solid. The training dataset consists of 125 rectangular solids with different height, width and length. Here the height, width and length are uniformly distributed on [1,2] with 5 amounts, i.e., 1,1.25,1.5,1.75,2 . Here, We consider four sets of different height, width and length of rectangular solids which are not covered by the training data. The imaging results with different characteristic values are shown in Figure 3, where the black dotted lines denote the shadows of the exact cube boundary. Due to discontinuities of the source, there is Gibbs phenomena on the boundary of the rectangular solids. On the whole, given the characteristic values, our proposed method is valid for determining the geometry shape.

    Figure 3.  Isosurface plots of rectangular solid with different height, width and length, where the isosurface value is 1 . The sets of height, width and length are as follows: (a) (1.9,1.2,1.4) , (b) (1.2,1.5,1.8) , (c) (1.6,1.8,1.3) , (d) (1.8,1.8,1.8).

    In last example, we consider a challenging case and verify the proposed method by using a set of synthetic experiments on 3D human body shape. The training dataset consists of 25 bodies which are generated by the MakeHuman soft [42]. MakeHuman soft is an open source software designed to create 3D virtual human models using 3D morphing technology. Providing the main parameters gender, age, muscle mass, weight, height, proportion and ethnicity, etc. of any specific character, the intermediate human shape can be reproduced with its large and own database. In this experiment, we consider two characteristic values, i.e., height and relative weight. Define the exact weight by EW and standard weight by SW , then the relative weight RW is calculated by

    RW=EWSW×100%.

    Here the height of the body is given by 1.5m,1.6m,1.7m,1.8m,1.9m and the relative weight of the body is given by 60%,80%,100%,120%,140% . Some human body shapes in the training dataset are presented in Figure 4. In addition, we choose two characteristic values of human body which are not covered by the training data. The first body's height is 1.55m and the relative weight is 130% . The second body's height is 1.85m and the relative weight is 110% . Figure 5(a) and Figure 6(a) present the exact body shape with the given characteristic value. Figure 5(b) and Figure 6(b) show the prediction of the human body shape with the given characteristic value. The results show that our method is efficient to predict the human body shape.

    Figure 4.  Isosurface plots of some training body data. Relative weight: the left column is 60% ; the center column is 100% , the right column is 140% ; height: the top row is 1.50m , the center row is 1.70m , the bottom row is 1.90m.
    Figure 5.  The relative weight is 130% , the height is 1.55m . (a) Exact body, (b) reconstruction body.
    Figure 6.  The relative weight is 110% , the height is 1.85m . (a) Exact body, (b) reconstruction body.

    In this paper, we develop a machine-learning method in generating a geometric body shape through prescribing a set of characteristic values of the body. The generation is mainly based on a given training dataset consisting of certain pre-selected body shapes with statistically well-sampled characteristic values. A major novelty and critical ingredient of our study is the borrowing of inverse scattering techniques in the theory of wave propagation to the geometric shape generation. We introduce the notion of shape generator which establishes a one-to-one correspondence between the geometric shape space and the function space consisting of the multiple-frequency far-field patterns associated with the time-harmonic source scattering problem. The shape generator plays an intermediate role in the geometric shape generation. First, the training dataset of geometric shapes is converted into a subset of the function space consisting of the corresponding shape generators. Then a learning model is derived through a functional interpolation of the aforementioned shape generators. For a given set of characteristic values, one then uses the learning model to obtain the shape generator of the underlying geometric body and finally reconstructs it through a multiple-frequency Fourier method.

    In the current article, the shape generator is introduced through an inverse source scattering model where we make use of the one-to-one correspondence between a geometric shape and the multiple-frequency far-field pattern associated with a compactly-supported acoustic source. One may consider to introduce the shape generator through other inverse scattering models, e.g., the inverse acoustic obstacle scattering model (cf. [28,29,31]) or the inverse electromagnetic scattering model (cf. [27,30]). In doing so, one may achieve other geometric shape generation schemes that are suitable for different applications.

    The work of H. Liu was supported by the FRG and startup grants from Hong Kong Baptist University, Hong Kong RGC General Research Funds, 12302017, 12301218 and 12302919.

    The authors declare no conflict of interest.



    [1] Levoy M, Pulli K, Curless B, et al. (2000) The digital Michelangelo project: 3D scanning of large statues. Proceedings of the 27th annual conference on computer graphics and interactive techniques, ACM Press 131-144.
    [2] Hou H, Andrews H (1978) Cubic splines for image interpolation and digital filtering. IEEE Trans Acoust, Speech, Signal Process 26: 508-517. doi: 10.1109/TASSP.1978.1163154
    [3] Mundermann L, Corazza S, Andriacchi TP (2007) Accurately measuring human movement using articulated ICP with soft-joint constraints and a repository of articulated models. 2007 IEEE Conference on Computer Vision and Pattern Recognition 1-6.
    [4] Anguelov D, Srinivasan P, Koller D, et al. (2005) SCAPE: Shape completion and animation of people. ACM T Graphic 24: 408-416. doi: 10.1145/1073204.1073207
    [5] Apeagyei PR (2010) Application of 3D body scanning technology to human measurement for clothing Fit. JDCTA 4: 58-68.
    [6] Ashdown SP, Loker S, Schoenfelder K, et al. (2004) Using 3D scans for fit analysis. JTATM 4: 1-12.
    [7] Loker S, Ashdown S, Schoenfelder K (2005) Size-specific analysis of body scan data to improve apparel fit. JTATM 4: 1-15.
    [8] Balan AO, Sigal L, Black MJ, et al. (2007) Detailed human shape and pose from images. 2007 IEEE Conference on Computer Vision and Pattern Recognition 1-8.
    [9] Guan P, Weiss A, Balan AO, et al. (2009) Estimating human shape and pose from a single image. 2009 IEEE 12th International Conference on Computer Vision 1381-1388.
    [10] Freifeld O, Black MJ (2012) Lie bodies: A manifold representation of 3D human shape. European Conference on Computer Vision 1-14.
    [11] Chen F, Brown GM, Song M (2000) Overview of 3-D shape measurement using optical methods. Opt Eng 39: 10-23. doi: 10.1117/1.602438
    [12] Kart O, Kut A, Vuruskan A, et al. (2012) Web based digital image processing tool for body shape detection. ICT Innovations 2011, Web Proceedings ISSN 1857-7288 139-147.
    [13] Chen X, Guo Y, Zhao Q, et al. (2012) Clothed and naked human shapes estimation from a single image. International Conference on Computational Visual Media 43-50.
    [14] Chen Y, Cipolla R (2009) Learning shape priors for single view reconstruction. 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops 1425-1432.
    [15] Chen Y, Cipolla R (2011) Single and sparse view 3d reconstruction by learning shape priors. Comput Vis Image Und 115: 586-602. doi: 10.1016/j.cviu.2010.10.015
    [16] Chen Y, Cipolla R, Robertson DP (2011) A practical system for modelling body shapes from single view measurements. The British Machine Vision Conference 1-11.
    [17] Seo H, Cordier F, Magnenat-Thalmann N (2003) Synthesizing animatable body models with parameterized shape modifications. Proceedings of the 2003 ACM SIGGRAPH/Eurographics Symposium on Computer Animation 120-125.
    [18] Seitz SM, Curless B, Diebel J, et al. (2006) A comparison and evaluation of multi-view stereo reconstruction algorithms. 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition 1: 519-528.
    [19] De Boor C (1972) On calculating with B-splines. J Approx Theory 6: 50-62. doi: 10.1016/0021-9045(72)90080-9
    [20] Dunn SM, Keizer RL, Yu J (1989) Measuring the area and volume of the human body with structured light. IEEE T Syst Man Cy 19: 1350-1364. doi: 10.1109/21.44059
    [21] Eskin G (2011) Lectures on Linear Partial Differential Equations, Providence: American Mathematical Society.
    [22] Esteban CH, Schmitt F (2004) Silhouette and stereo fusion for 3D object modeling. Comput Vis Image Und 96: 367-392. doi: 10.1016/j.cviu.2004.03.016
    [23] Zhou S, Fu H, Liu L, et al. (2010) Parametric reshaping of human bodies in images. ACM T Graphic 29: 126.
    [24] Geng J (2011) Structured-light 3D surface imaging: a tutorial. Adv Opt Photonics 3: 128-160. doi: 10.1364/AOP.3.000128
    [25] Wang X, Guo Y, Li J, et al. (2019) Two gesture-computing approaches by using electromagnetic waves. Inverse Probl Imaging 13: 879-901. doi: 10.3934/ipi.2019040
    [26] Li J, Liu H, Ma S (2019) Determining a random Schrödinger equation with unknown source and potential. SIAM J Math Anal 51: 3465-3491. doi: 10.1137/18M1225276
    [27] Li J, Liu H, Wang Q (2015) Fast imaging of electromagnetic scatterers by a two-stage multilevel sampling method. Discrete Conts Dyn S 8: 547-561.
    [28] Li J, Liu H, Zou J (2008) Multilevel linear sampling method for inverse scattering problems. SIAM J Sci Comput 30: 1228-1250. doi: 10.1137/060674247
    [29] Li J, Liu H, Zou J (2009) Strengthened linear sampling method with a reference ball. SIAM J Sci Comput 31: 4013-4040.
    [30] Liu H, Yamamoto M, Zou J (2007) Reflection principle for Maxwell's equations and its application to inverse electromagnetic scattering problem. Inverse Probl 23: 2357-2366. doi: 10.1088/0266-5611/23/6/005
    [31] Liu H, Zou J (2006) Uniqueness in an inverse acoustic obstacle scattering problem for both soundhard and sound-soft polyhedral scatterers. Inverse Probl 22: 515-524. doi: 10.1088/0266-5611/22/2/008
    [32] Kasap M, Magnenat-Thalmann N (2007) Parameterized human body model for real-time applications. 2007 International Conference on Cyberworlds 160-167.
    [33] Lee SW, Yang HD (2007) Reconstruction of 3D human body pose from stereo image sequences based on top-down learning. Pattern Recognit 40: 3120-3131. doi: 10.1016/j.patcog.2007.01.033
    [34] Liu L, Pan Z, Tong J, et al. (2012) Scanning 3d full human bodies using kinects. IEEE T Vis Comput Gr 18: 643-650. doi: 10.1109/TVCG.2012.56
    [35] Magnenat-Thalmann N, Seo H (2003) An automatic modeling of human bodies from sizing parameters. Proceedings of the 2003 Symposium on Interactive 3D Graphics 19-26.
    [36] Schoenberg IJ (1973) Cardinal Spline Interpolation. SIAM.
    [37] Schoenberg IJ (1946) Contributions to the problem of approximation of equidistant data by analytic functions. Part B. On the problem of osculatory interpolation. A second class of analytic approximation formulae. Q Appl Math 4: 112-141.
    [38] Treleaven P, Wells J (2007) 3D body scanning and healthcare applications. Comput 40: 28-34.
    [39] Wang X, Song M, Guo Y, et al. (2019) Fourier method for identifying electromagnetic sources with multi-frequency far-field data. J Comput Appl Math 358: 279-292. doi: 10.1016/j.cam.2019.03.013
    [40] Wang X, Guo Y, Liu H, et al. (2017) Fourier method for recovering acoustic sources from multifrequency far-field data. Inverse Probl 33: 035001. doi: 10.1088/1361-6420/aa573c
    [41] The World's First Human Visualization Platform, Anatomy, Disease and Treatments-all in interactive 3D, BioDigital, Inc., 2018. Available from: https://www.biodigital.com/.
    [42] Make Human Community: Open Source tool for making 3D characters. Available from: www.makehumancommunity.org.
  • This article has been cited by:

    1. Lauri Oksanen, Mikko Salo, Inverse problems in imaging and engineering science, 2020, 2, 2640-3501, 287, 10.3934/mine.2020014
    2. Weishi Yin, Wenhong Yang, Hongyu Liu, A neural network scheme for recovering scattering obstacles with limited phaseless far-field data, 2020, 417, 00219991, 109594, 10.1016/j.jcp.2020.109594
    3. Pinchao Meng, Xinyu Wang, Weishi Yin, ODE-RU: a dynamical system view on recurrent neural networks, 2021, 30, 2688-1594, 257, 10.3934/era.2022014
    4. Birgitta Dresp-Langley, Color Variability Constrains Detection of Geometrically Perfect Mirror Symmetry, 2022, 10, 2079-3197, 99, 10.3390/computation10060099
    5. 琳 王, A Recurrent Neural Network Model for Inverse Scattering Obstacles, 2023, 12, 2324-7991, 1013, 10.12677/AAM.2023.123103
    6. Pinchao Meng, Lin Wang, Weishi Yin, Linhua Zhou, A novel recurrent neural network of gated unit based on Euler's method and application, 2023, 0, 2837-0562, 0, 10.3934/cac.2023007
    7. Youzi He, Hongyu Liu, Xianchao Wang, A novel quantitative inverse scattering scheme using interior resonant modes, 2023, 39, 0266-5611, 085002, 10.1088/1361-6420/acdc49
    8. Weishi Yin, Jiawei Ge, Pinchao Meng, Fuheng Qu, A neural network method for the inverse scattering problem of impenetrable cavities, 2020, 28, 2688-1594, 1123, 10.3934/era.2020062
    9. Youzi He, Bin Li, Tingting Sheng, Xianchao Wang, Generating geometric body shapes with electromagnetic source scattering techniques, 2020, 28, 2688-1594, 1107, 10.3934/era.2020061
    10. Huaian Diao, Hongyu Liu, 2023, Chapter 1, 978-3-031-34614-9, 1, 10.1007/978-3-031-34615-6_1
    11. Pinchao Meng, Zhaobin Xu, Xianchao Wang, Weishi Yin, Hongyu Liu, A novel method for solving the inverse spectral problem with incomplete data, 2025, 463, 03770427, 116525, 10.1016/j.cam.2025.116525
    12. Yunwen Yin, Liang Yan, Physics-Aware Deep Learning Framework for the Limited Aperture Inverse Obstacle Scattering Problem, 2025, 47, 1064-8275, C313, 10.1137/24M1665222
  • Reader Comments
  • © 2019 the Author(s), licensee AIMS Press. This is an open access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0)
通讯作者: 陈斌, bchen63@163.com
  • 1. 

    沈阳化工大学材料科学与工程学院 沈阳 110142

  1. 本站搜索
  2. 百度学术搜索
  3. 万方数据库搜索
  4. CNKI搜索

Metrics

Article views(5310) PDF downloads(584) Cited by(11)

Figures and Tables

Figures(6)  /  Tables(1)

/

DownLoad:  Full-Size Img  PowerPoint
Return
Return

Catalog