
Data-driven and feedback cycle-based approaches are necessary to optimize the performance of modern complex wireless communication systems. Machine learning technologies can provide solutions for these requirements. This study shows a comprehensive framework of optimizing wireless communication systems and proposes two optimal decision schemes that have not been well-investigated in existing research. The first one is supervised learning modeling and optimal decision making by optimization, and the second is a simple and implementable reinforcement learning algorithm. The proposed schemes were verified through real-world experiments and computer simulations, which revealed the necessity and validity of this research.
Citation: Koji Oshima, Daisuke Yamamoto, Atsuhiro Yumoto, Song-Ju Kim, Yusuke Ito, Mikio Hasegawa. Online machine learning algorithms to optimize performances of complex wireless communication systems[J]. Mathematical Biosciences and Engineering, 2022, 19(2): 2056-2094. doi: 10.3934/mbe.2022097
[1] | Nur Jassriatul Aida binti Jamaludin, Shanmugan Subramani, Mutharasu Devarajan . Thermal and optical performance of chemical vapor deposited zinc oxide thin film as thermal interface material for high power LED. AIMS Materials Science, 2018, 5(3): 402-413. doi: 10.3934/matersci.2018.3.402 |
[2] | Nur Jassriatul Aida binti Jamaludin, Shanmugan Subramani . Thermal performance of LED fixed on CVD processed ZnO thin film on Al substrates at various O2 gas flow rates. AIMS Materials Science, 2018, 5(2): 246-256. doi: 10.3934/matersci.2018.2.246 |
[3] | Keith E. Whitener Jr . Rapid synthesis of thin amorphous carbon films by sugar dehydration and dispersion. AIMS Materials Science, 2016, 3(4): 1309-1320. doi: 10.3934/matersci.2016.4.1309 |
[4] | Mohammed Tareque Chowdhury, Md. Abdullah Zubair, Hiroaki Takeda, Kazi Md. Amjad Hussain, Md. Fakhrul Islam . Optical and structural characterization of ZnSe thin film fabricated by thermal vapour deposition technique. AIMS Materials Science, 2017, 4(5): 1095-1121. doi: 10.3934/matersci.2017.5.1095 |
[5] | Timur Zinchenko, Ekaterina Pecherskaya, Dmitriy Artamonov . The properties study of transparent conductive oxides (TCO) of tin dioxide (ATO) doped by antimony obtained by spray pyrolysis. AIMS Materials Science, 2019, 6(2): 276-287. doi: 10.3934/matersci.2019.2.276 |
[6] | Shuhan Jing, Adnan Younis, Dewei Chu, Sean Li . Resistive Switching Characteristics in Electrochemically Synthesized ZnO Films. AIMS Materials Science, 2015, 2(2): 28-36. doi: 10.3934/matersci.2015.2.28 |
[7] | Claas Hüter, Shuo Fu, Martin Finsterbusch, Egbert Figgemeier, Luke Wells, Robert Spatschek . Electrode–electrolyte interface stability in solid state electrolyte systems: influence of coating thickness under varying residual stresses. AIMS Materials Science, 2017, 4(4): 867-877. doi: 10.3934/matersci.2017.4.867 |
[8] | Ya-Ting Tsu, Yu-Wen Chen . Preparation of gold-containing binary metal clusters by co-deposition-precipitation method and for hydrogenation of chloronitrobenzene. AIMS Materials Science, 2017, 4(3): 738-754. doi: 10.3934/matersci.2017.3.738 |
[9] | Vishanth Uppu, Kunal Mishra, Libin K. Babu, Ranji Vaidyanathan . Understanding the influence of graphene and nonclay on the microcracks developed at cryogenic temperature. AIMS Materials Science, 2019, 6(4): 559-566. doi: 10.3934/matersci.2019.4.559 |
[10] | DavidWood, Dale K. Hensley, Nicholas Roberts . Enhanced thermal conductance of polymer composites through embeddingaligned carbon nanofibers. AIMS Materials Science, 2016, 3(3): 851-861. doi: 10.3934/matersci.2016.3.851 |
Data-driven and feedback cycle-based approaches are necessary to optimize the performance of modern complex wireless communication systems. Machine learning technologies can provide solutions for these requirements. This study shows a comprehensive framework of optimizing wireless communication systems and proposes two optimal decision schemes that have not been well-investigated in existing research. The first one is supervised learning modeling and optimal decision making by optimization, and the second is a simple and implementable reinforcement learning algorithm. The proposed schemes were verified through real-world experiments and computer simulations, which revealed the necessity and validity of this research.
Metal-hydrogen systems offer grand opportunities for studies on fundamental aspects of alloy thermodynamics [1,2,3,4,5,6,7,8,9,10,11,12,13,14]. The interaction of solutes with structural defects of the metal can easily be assessed [2,6,15,16,17,18], as well as precipitation and growth of phases [5,9,10,19,20,21]. This is enabled by two unique properties of metal-hydrogen systems: First, the chemical potential of hydrogen in the metal can simply be controlled by the surrounding hydrogen gas pressure or by the electromotoric force in electrochemical loading experiments. This allows to directly link the chemical potential with other measured alloy properties. Second, hydrogen often is highly mobile in metals even at room temperature, facilitating experiments on reasonable time scales. Reducing the alloy size to the nano scale, the volume fraction of interfaces increases. This changes the systems properties due to interface effects, which relate to microstructural defects as well as to mechanical stress [6,8,10,11,18,19,22,23,24]. Interface effects modify the hydrogen atoms’ site occupancy in the solid solution regime as well as the stability of hydride phases. In turn, hydrogen can be utilized as a probe for the systems’ microstructure.
Hydrogen absorption usually accompanies with a hydrogen-induced volume expansion of the metal. Depending on the specific metal-hydrogen system, the volume expansion reaches 10-20%, when one hydrogen atom is dissolved per metal atom [1,3]. In metal thin films adhered to rigid substrates, the in-plane expansion is hindered by the substrate, yielding large compressive in-plane stresses of the order of several GPa [25,26]. This changes the thermodynamics of the system. Recently [10,19], we proposed a quasi-thermodynamic model to reveal the interplay of substrate-induced stress, chemical potential and hydride formation in metal-hydrogen thin films. This enables the determination of the attractive H-H interaction energy and of the critical temperature of hydride formation. For the model case of palladium-hydrogen (Pd-H) thin films with different microstructures, in the present manuscript we complete this model by focusing on interface contributions via the hydrogens’ site occupancy in the presence of microstructural defects. Evaluating the chemical potential in the low concentrated solid solution regime allows for the reconstruction of the related distribution of site energies. This enables us to evaluate the volume fractions of interface regions in the films and to reveal the character of the occupied defect sites.
Hence, in this paper we aim to investigate the distribution of site energies in palladium-hydrogen thin films of different thickness and microstructure in the solid solution regime. We propose a model taking the substrate-induced stress contribution to the chemical potential of the films into account. Fitting measured chemical potentials of the films with respect to this model enables us to determine the related densities of sites, including interstitial sites and different kinds of defect sites. From this, we estimate volume fractions and the character of the defect sites in the films.
In the undistorted Pd metal lattice hydrogen occupies octahedral interstitial sites. At low H-concentrations a solid solution α-phase forms, until the precipitation of a high concentration hydride α'-phase sets in at the solid solution limitxmaxα. In bulk Pd, hydrogen absorption results in an isotropic lattice expansion (Eq 1)
∆aa=ϵ0=ηHxH | (1) |
with the expansion factor ηH=0.063(3) [1] and the lattice constant a=0.389nm of pure palladium. This relation also holds for the two-phase region [16], taking the mean hydrogen concentration xH of the sample into account. Thereby, xH is defined as dissolved hydrogen atoms per palladium atom [H/Pd]. Hence, each dissolved H-atom is surrounded by an elastic strain field of the Pd lattice. The H atoms attractively interact via these strain fields, yielding an elastic contribution to the chemical potential [27] and initiating hydride formation at the solid solution limitxmaxα. As first described by Lacher [28], within a linear approximation of the elastic interaction the chemical potential μHof H in bulk Pd is commonly given by (Eq 2) [3,29]
μH=RTln(xHr−xH)+E0−EHHxH | (2) |
with gas constant R and absolute temperature T. The first term in Eq 2 describes the configurational entropy of H dissolved on the octahedral sites and the maximum fraction r of sites that can be occupied by hydrogen. r is determined both by the electronic structure [30] and the microstructure [31] of the metal host and accounts mainly for the composition of the hydride phase. Within this model the hydrogen atoms enter sites with a sharp site energy E0, while the H-H interaction energy is characterized by an interaction strength parameter EHH. Standard values for bulk Pd have been determined by Wicke or Kirchheim, Mütschele and others to be E0=3.9−7.7kJ/mol [22,27,32] and EHH=30kJ/mol [22].
Mechanical stress resulting from elastic constraints changes the chemical potential. Cahn and Larché [33,34,35] have shown for the general case of systems exposed to stress that the chemical potential is modified in leading order by (Eq 3)
∆μH(σii)=−v0ηHσii | (3) |
where v0 is the partial molar volume of sites occupied by an interstitial species and σii is the sum of axial stresses. Considering octahedral sites in Pd, the volume density is v0=8.56×10−6m3/mol [27].
In thin films the stress contribution to the chemical potential mainly depends on the substrate-induced in-plane stress, while vertical interface stress contributions resulting at phase interfaces within the film cancel out [10,19]. In total, with a superposition of the H-H interaction and of the substrate-induced stress-contribution, the chemical potential of thin films can be written Eq 4 [10,19]
μH=RTln(xHr−xH)+E0−EHHxH−v0ηHσii(xH) | (4) |
with i=(1,2).
The substrate-induced stress σii can be measured by a substrate deflection method [36,10]. With this measured stress dependency, Eq 4 enables a description of the thermodynamic conditions of hydride formation in the Pd-H thin films adhered to substrates, converging to the measured sloped chemical potential plateau in the two-phase field in terms of a Maxwell-construction—reflecting the measured two-phase co-existence [10,19]. However, as exemplarily shown in Figure 1a for the example of an 80 nm nano crystalline Pd-H film on a silicon substrate, the fit function of Eq 4 (blue line) remarkably deviates from the measured chemical potential in the α-phase region below the solid solution limit. This differs from the measured chemical potential of the Pd-H bulk system (with σii=0) shown in Figure 1b, where the fit function of Eq 4 nicely describes the low concentration regime. We note that deviations of the bulk isotherm from the measured data in the two-phase region of the bulk system in Figure 1b are self-evident: In the concentration range of the two-phase equilibrium, the isotherm oscillates around the measured chemical potential. The constant potential data can be obtained by the Maxwell-construction; this has been targeted in reference [10].
Isotherms of Pd thin films of other microstructures and thicknesses are presented in the supplemental information. They show a similar behavior to the film in Figure 1a. Hence, in the manuscript we picture results of the 80 nm nano crystalline Pd film as case examples.
Within the framework of this model, the observed deviation is caused by the restriction to a sole site energy E0 in Eq 4: In thin films a number of microstructural defects such as surfaces, interfaces and dislocations with additional site energies for hydrogen are present. Open-volume defects like grain boundaries, vacancies and the dilatation fields of edge dislocations with a locally expanded lattice can interact attractively with hydrogen induced strain fields and hence offer more negative site energies than the conventional interstitial sites. This results in a preferable H-occupation of open-volume defects [6,18,31]. Re-writing Eq 4 as Eq 5
RTln(xHr−xH)+E0=μH+EHHxH+v0ηHσii(xH) | (5) |
illustrates that in case of defective metals the left hand side of the equation has to be replaced by a distribution of sites and site energies [22,31]. Subsequently, we will show that this approach enables a reasonable fit of the measured chemical potential curves of Pd-H thin films in the solid solution regime. Following the approach of an additive contribution of substrate-induced stresses to the chemical potential, the measured stress contribution v0ηHσii(xH) has to be substracted from the measured chemical potential μH to determine pure site energies. Any change in the H-H-interaction contribution EHHxH is neglected, here. It has a minor impact on the isotherm in the low concentration regime, and it would yield a self-referred contribution to the hydrogen concentration xH of the film. Its effect on the fitting parameters in the low concentration regime is discussed in the supplemental information.
Following an approach of Kirchheim et al. [2,22,24,37,38], within the framework of statistical thermodynamics the distribution of hydrogen atoms among a number of different sites can be described by using Fermi-Dirac statistics and the related density of sites (DOS), given by Z(E). Since the chemical potential of hydrogen atoms in different sites is equal at a given overall hydrogen concentration of the film, in turn the total concentration xH of hydrogen atoms in the metal at a given chemical potential μH is determined by integrating over the energies E of Z(E) multiplied with the Fermi-Dirac function (Eq 6) [2,37],
xH(μH)=r⋅∞∫−∞Z(E)1+exp(E−μHRT)dE | (6) |
In turn, this enables the reconstruction of the density of sites Z(E), when μH(xH) is measured.
Considering conventional interstitial lattice sites with a sharp site energy E0, the DOS transforms to a delta-distribution (Eq 7) [2],
Z(E)=δ(E−E0) | (7) |
In defective metals a fraction f of the interstitial lattice sites is replaced by sites with a different energy distribution. Considering sites like grain boundaries with a distribution of atom arrangements, following an idea of White et al. the DOS can be described by a Gaussian distribution (Eq 8) with half width σ1 around peak energy E1 [39,2],
Z(E)=1σ1√π⋅exp(−(E−E1σ1)2) | (8) |
For dislocations the situation is more complicated [2,37]. Here, hydrogen atoms tend to form elongated hydrides in the dilatation fields of edge dislocations at low overall hydrogen concentrations in the metal. Considering the related DOS with an energy EV of hydride formation close to the dislocation and assuming an octahedral symmetry of the dislocation sites [2], it is Eq 9 [37]
Z(E)=−ρπ(A⋅VH)22(E−EV)3 | (9) |
with the dislocation areal density ρ and the partial volume of hydrogen atoms in metals, VH=1.69×10−6m3/mol [3]. Furthermore, the parameter A is given by A=Gb(1+v)3π(1−v) with shear modulus G=44.7GPa, Burgers vector b=0.275nm and Poisson ratio v=0.523 in the (111) plane of a Pd thin film with [111] texture [10].
To fit the measured chemical potential curves of Pd-H thin films, depending on the film structure we will take into account one or two kinds of sites with sharp site energy E0 and Eil0 (representing interstitial sites) and two different kinds of sites with Gauss distributed site energies E1 and E2. The two Gaussians may represent grain/domain boundary sites and deep traps. As discussed below, we will not consider dislocations. For simplicity, we will furthermore assume r=1H/Pd, neglecting the blocking of octahedral interstitial sites. This is justified at low overall hydrogen concentrations, regarded here. Within our approach we use as few fitting parameters as possible, that can be clearly distinguished from a physical point of view.
In the regular fcc Pd lattice the number of octahedral interstitial sites equals that of the Pd atoms, yielding the relation f0=1−f1−f2 for the number density f0 of available interstitial sites in Pd. For some Pd films (see below), an additional adhesive vanadium interlayer was placed in-between the Pd film and the substrate. This layer offers additional interstitial sites fil0 of site energy Eil0, that add on top of the sites in the Pd film. Then, in total the DOS of the Pd films is given by (Eq 10)
Z(E)=(1−f1−f2)⋅δ(E−E0)+fil0⋅δ(E−Eil0)+∑2i=1fiσi√π⋅exp(−(E−Eiσi)2) | (10) |
Evaluating the total hydrogen concentration in a film referring to Eq 6, all partial DOS of Eq 10 can be treated separately, and the partial hydrogen concentrations can be summed up, subsequently. Integrating the first two parts of Eq 6 with 10 (Eq 11)
xH,0(μH)=(1−f1−f2)⋅∞∫−∞δ(E−E0)1+exp(E−μHRT)dE+fil0⋅∞∫−∞δ(E−Eil0)1+exp(E−μHRT)dE | (11) |
yields the common result (Eq 12)
xH,0(μH)=(1−f1−f2)⋅11+exp(E0−μHRT)+fil0⋅11+exp(Eil0−μHRT) | (12) |
which is equivalent to μH=RTln(xH1−xH)+E0 for f1=f2=fil0=0.
For the Gaussian parts of Eqs 6 and 10 no primitives exist. However, the partial hydrogen concentration xH,1,2 in sites with Gaussian site energy distribution can be calculated numerically, when the integral is transformed into a sum over n discrete energies ∆Ej=(Ej−Ej−1) on a properly chosen energy interval [a,b]. Then (Eq 13),
xH,1,2(μH)=∞∫−∞∑2i=1fiσi√π⋅exp(−(E−Eiσi)2)1+exp(E−μHRT)dE≈b∫a∑2i=1fiσi√π⋅exp(−(E−Eiσi)2)1+exp(E−μHRT)dE |
≈∑nj=1[∑2i=1fiσi√π⋅exp(−(Ej−Eiσi)2)1+exp(Ej−μHRT)⋅∆Ej]=∑nj=1[∆xjH,1,2(Ej,μH)] | (13) |
This sum can be calculated stepwise for discrete values of μH. Together with Eq 12 it yields the total hydrogen concentration as a function of the chemical potential (Eq 14)
xH=xH(μH) | (14) |
in the film for each given μH, with E0,Eil0,E1,E2,σ1,σ2,f1 and f2 left as fitting parameters of the DOS to represent the measured chemical potential. fil0, on the other hand, can be calculated from the thickness of the V interlayer. Relative to the Pd layer thickness it is (Eq 15)
fil0=dVdPd⋅vPdvV | (15) |
with the thicknesses dV and dPd of the V interlayer and the Pd film, and the molar volumes vV=8.32×10−6m3/mol of vanadium and vPd=8.56×10−6m3/mol of palladium [27]. Since we correct the measured chemical potential data for the measured substrate-induced stress contribution, we call our model the “σDOS model”.
The Gaussian functions in Eq 13 decrease rapidly to the left and to the right hand sides of the peak energies. Setting a=−80kJ/mol<Ej≤b=+40kJ/mol and ∆Ej=0.2kJ/mol is a reasonable choice in case of the investigated Pd-H thin films: with the fitting parameters in Table 1, the incremental concentration steps are ∆xjH,1,2<1×10−14 H/Pd at the borders of [a, b].
24-200 nm Pd films were Ar-ion beam sputtered at 2×10−4mbar in an UHV chamber with a background pressure of the order of 10−10mbar. The sputter rate was 1nm/min. Microstructure and adhesion conditions of the films were adjusted by choosing two different substrates (Silicon (Si) [001] with its native surface oxide layer and sapphire (Al2O3) [0001]), by choosing the substrate temperature between 300 and 1073 K, and by adding a 1nm adhesive V-interlayer (V//Al2O3) for the epitaxial films. All films contained a small amount of iron xFe=1−2at%, resulting from the film’s cathode beam sputtering in the UHV vessel. The substrates dimensions were 30 mm × 7 mm × (0.1-0.5) mm. The Pd films’ microstructures were described elsewhere [40]. At 300 K, Pd grows with [111] fibre texture and in-plane grain sizes of 30-50 nm on silicon substrates. These films are called “nano crystalline films”. Pd on sapphire sputtered at 673 K has a multi-oriented, polycrystalline microstructure with twinned domains. These films are named “multi-oriented films”. Pd on sapphire with an adhesive V-interlayer grows seeded epitaxially at 673 K. The films are called “epitaxial films”.
After film preparation, XRD stress analysis yields compressive intrinsic in-plane stresses of the order of σ0=−1.3GPa for nano crystalline Pd films on Si. Multi-oriented films on Al2O3 and epitaxial films on V//Al2O3 are strained in tension with stresses of σ0=+0.2to+0.8GPa, see reference [41].
The Pd films were loaded stepwise with hydrogen by electrolytical charging in 2/3 glycerin (80%) and 1/3 phosphoric acid (80%) [19]. The chemical potential μHof hydrogen in the films (Eq 16a) was determined in reference to a saturated Ag/AgCl-electrode, as from Nernst equation [12,13,31]
μH=(U−U0)⋅F+μ0H2(T)/2 | (16a) |
with Faradays constant F, electromotive force (EMF) U and standard potential U0=0.181V. The standard potential was determined for a 100 µm thick Pd bulk sheet. The offset term in Eq 16a refers to the standard chemical potential of gaseous hydrogen. It is (Eq 16b)
μ0H2/2=−231.8kJ/mol | (16b) |
at T=297K, see the supplemental information for details. As conventionally done in the corresponding literature on metal hydrogen systems [2,22,31,37,38,42], we here shift the energy scale by adding −μ0H2/2 to the chemical potential, essentially neglecting the offset term.
H-induced changes ∆σ11≡∆σ of the Pd films’ in-plane stress were determined in-situ by substrate curvature measurement in the long substrate direction. According to Stoney’s equation (Eq 17) [36].
∆σ=ESd2S6(1−vS)df⋅(1R−1R0) | (17) |
with the substrates’ elastic moduli ES and vS, substrate thickness dS, film thickness df, radius Rof substrate curvature and initial radius R0. The change of the radius of curvature was measured utilizing an induction sensor with a resonant circuit. A metal plate was glued to the backside of the substrates’ front end and placed close to the sensor. When the distance between plate and sensor changes due to substrate-bending, the measured capacity of the sensor changes due to eddy currents induced in the plate. This enables calibration of the substrate curvature [43]. A typical stress-concentration curve is shown in Figure 2 for the exemplary case of the 80 nm nano crystalline Pd-H film. Further stress data of the films was published in references [10] and [41].
Figure 3 shows the measured, stress-corrected chemical potentials (data points) of 80 nm Pd-H thin films with nano crystalline, multi-oriented and epitaxial microstructures and best fits (lines) according to Eq 14. For the nano crystalline and the multi-oriented film fil0 is fil0=0, while it is fil0=0.0127 for the epitaxial film. Apparently, the measured chemical potentials of the films with different microstructures differ systematically, with the smallest chemical potential at a given H-concentration for the nano crystalline film. This is in accordance with the expectation that nano crystalline films contain the largest number of open-volume defects.
As can be seen, the data points are well represented by the fitted curves. This is also expressed in Figure 4. There, the original, uncorrected μH data of the 80 nm nano crystalline Pd-H thin film is plotted together with the fit according to the quasi-thermodynamic approach of Eq 4 and with the fitted line according to Eq 14. In accordance with the data treatment described before, thereby the measured substrate-induced stress contribution was added back to the curve of Eq 14 after the fitting procedure. While the fit of Eq 4 strongly deviates from the measured chemical potential in the α-phase region, Eq 14 fits well, there. Hence, the fitted DOS with one delta and two Gaussian distributions well represents the measured chemical potential. In the supplemental information, we furthermore show that it is mandatory to use two Gaussian site energy distributions next to the interstitial sites to fit the chemical potential.
The fitted σDOS model parameters of Eq 14 are summarized in Table 1 for all investigated Pd-H films. Related isotherms are presented in the supplemental information. Reference data for bulk Pd according to references [10,22,32] is given in Table 1, as well. The fits are very sensitive to small changes in the fit parameters, yielding considerably small confidence intervals. This is discussed in more detail in the supplemental information.
Thickness (nm) | E0 (kJ/mol) | Eil0 (kJ/mol) | E1 (kJ/mol) | σ1 (kJ/mol) | f1 | E2 (kJ/mol) | σ2 (kJ/mol) | f2 | NSNV | |
Epitaxial Pd on 1 nm V/Al2O3 [0001], TDep = 673 K | 24 | 4.6(3) | -0.8(5) | 0.6(1) | 17.9(3) | 0.070(2) | -43(1) | 11.3(3) | 0.0019(1) | 0.0091 |
80 | 5.7(3) | -0.3(9) | 0.6(1) | 19.3(3) | 0.019(2) | -43(1) | 8.1(3) | 0.0007(1) | 0.0027 | |
200 | 4.8(3) | -0.3(9) | 0.5(1) | 17.1(5) | 0.017(2) | -42(1) | 8.1(3) | 0.0002(1) | 0.0011 | |
Multi-oriented Pd on Al2O3 [0001], TDep = 673 K | 24 | 1.8(3) | n/a | 0.5(1) | 15.3(3) | 0.124(2) | -46(1) | 9.4(3) | 0.003(1) | 0.0091 |
80 | 4.4(3) | n/a | 0.5(1) | 16.6(3) | 0.055(2) | -45(1) | 5.6(3) | 0.0013(1) | 0.0027 | |
200 | 4.5(3) | n/a | 0.5(1) | 17.4(3) | 0.032(2) | -42(1) | 8.1(3) | 0.0005(1) | 0.0011 | |
Nano crystalline Pd on Si [100], TDep = 300 K | 24 | 1.0(3) | n/a | 0.5(1) | 14.5(3) | 0.25(2) | -44.0(5) | 5.9(3) | 0.003(1) | 0.0091 |
80 | 1.5(3) | n/a | 0.5(1) | 15.0(3) | 0.118(2) | -48.3(5) | 6.3(3) | 0.0021(1) | 0.0027 | |
200 | 1.0(3) | n/a | 0.7(1) | 14.5(3) | 0.100(2) | -48.0(5) | 7.1(3) | 0.0015(1) | 0.0011 | |
Reference: coarse grained [10,32] and nano crystalline [22] bulk Pd | bulk | 4.7-7.7 | n/a | n/a | n/a | n/a | - | - | - | 5.5 × 10−6 |
nc bulk | 3.9 | n/a | 9.2 | 15 | 0.3 | - | - | - | 5.5 × 10−6 |
In Figure 5, the fitted density of sites of the 80 nm nano crystalline Pd-H film is compared to the DOS determined by Mütschele and Kirchheim for nano crystalline bulk in reference [22].
Figure 4 exemplarily shows the measured data for one chosen Pd-H film, and two related fit curves of the quasi-thermodynamic approach and the σDOS model. For both fit curves, the measured stress contribution to the chemical potential is separated from the fitting procedure. The quasi-thermodynamic approach (blue line) considers octahedral interstitial sites only, which hydrogen occupies in bulk material. The red line according to the fitted DOS in Figure 5 touches the curve of the quasi-thermodynamic approach close to the solid solution limitxmaxα of the film. This observation hints on saturation of sites different from octahedral interstitial sites within the films’ α-phase region. Furthermore, it shows that the onset of hydride formation in the films is determined by hydrogen located in interstitial sites.
On a closer look the slope of the σDOS model curve is larger than that of the quasi-thermodynamic approach close to xmaxα. This effect is caused by the H-H interaction not implemented in Eq 14, that bends down μH(xH) when the film enters the plateau region of the two-phase field [10,22]. This aspect is discussed in the supplemental information.
The absolute values of E0 of the interstitial sites in Pd are plotted in Figure 6 together with the marked range (between the dashed lines) of bulk values [10,22,32] for the energy range determined for octahedral interstitial sites in Pd.
Apparently, the site energy values E0 of the thicker multi-oriented (green triangles) and of the epitaxial (red spheres) Pd-H films fall into the range of the bulk values, while that of the nano crystalline films (black squares) and of the thinnest 24 nm multi-oriented film are reduced by 2−3kJ/mol. This hints on an interfacial stress contribution of the grain boundaries on the grains, as proposed by Weissmüller and Lemier [23,44]: In their model, the hydrogen filled grain boundaries affect the grain interior of nano crystalline Pd-H samples. In the low concentration α-phase regime the H-occupation of grain boundary sites leads to a tensile straining of the grain interior, which increases the H binding energy to the interstitial sites, expressed by a reduction of the site energy E0.
In thin films adhered to rigid substrates, all straining effects are anisotropic, yielding a surplus vertical expansion and hence a tetragonal distortion of the films [41]. Hence, the grain-boundary straining effect will be anisotropic, as well, and it should increase with an increasing volume fraction of grain boundaries. This is confirmed by the fitting parameters in Table 1.
According to Table 1, for all investigated Pd-H thin films the obtained grain boundary energies E1 and the half widths σ1 of the energy distributions are similar within E1=0.5−0.7kJ/mol and σ1=15−19kJ/mol, respectively. This remarkable result is not expected at first hand, since the grain boundary structure of nano crystalline films and of films of other microstructures can be assumed to differ. However, it has been shown both for fibre textured as well as for epitaxial metal thin films that the crystalline texture assists the formation of special low-Σ grain boundary fractions [45,46,47], forming a two dimensional network with general grain boundary fractions [45,48]. This supports the experimental result that grain/domain boundaries in Pd-H thin films of different microstructures can be described by similar model parameters. Interestingly, the half widths σ1 of the site energy distributions are also similar to the bulk value of 15kJ/mol determined for nano crystalline Pd in reference [22]. But, the absolute grain boundary energy E1 is shifted to less positive values for the thin films compared to the value of 9.1kJ/mol for Mütscheles and Kirchheims nano crystalline bulk Pd [22]. Hence, hydrogen is bound more strongly to grain/domain boundary sites in thin films compared to their nano crystalline bulk Pd samples. This observation suggests that the grain boundary structure of sputtered thin films differs from that of these nano crystalline bulk samples. This may result from the different preparation process of compacting gas phase condensated nano particles, the consolidating inert gas condensation (IGC) method [22,49]. As shown in Refs. [49,50], IGC nano crystalline bulk Pd samples similar to those investigated in reference [22] contain light element impurities (O, N, H) by preparation. The impurity content linearly increases with an increasing surface-to-volume ratio of the particles. This indicates that the impurities segregate to the grain boundaries of the samples, where they can block absorption sites for further hydrogen occupation. This might increase the mean grain boundary energy E1 of nano crystalline bulk Pd. At a particle size of 5−10nm like in reference [22], a total impurity content of 4.5−9at% is expected [50], with atom ratios O:H:N of 6:4:3 [49]. Complementary, possible segregation of substrate material, i.e. Si or V, in the grain/domain boundaries of the sputtered Pd films would change the film’s site energies compared to bulk material. Gemma et al. have investigated the interdiffusion of V and Pd by means of atom probe tomography, resulting in a steady V content of the order of 5at% in Pd close to the interface [51].
Another cause of reduced grain/domain boundary energies in thin films might be related to structural changes due the tetragonal distortion of adhered thin films, like it is observed for the interstitial site energies, as well.
Furthermore, for nano crystalline bulk Pd consisting of randomly oriented nano particles, grain boundaries with a partially amorphous intergranular phase have been reported [17,49,52]. Consideration of the similar widths σ1 of the energy distributions suggests that the general grain boundary fraction of the thin films contains amorphous parts, as well.
The grain/domain boundary structures proposed for nano crystalline and epitaxial Pd thin films as well as for nano crystalline bulk Pd are schematically compared in Figure 7.
Next to grain/domain boundary sites, deep traps are found for the Pd-H thin films. Their energy values E2 range between E2=−42kJ/mol and E2=−48kJ/mol. However, they group for the different microstructures with more positive values for the epitaxial films and more negative values for the nano crystalline films. Regarding the nature of these deep traps, three constituents of the films’ microstructure are at hand: the films’ surface, a natural surface oxide layer, and vacancies. Additionally, for the case of epitaxial Pd thin films the thin vanadium interlayer acts as a hydrogen trap, see Table 1. This was expected, since the binding energy of H to vanadium is larger than that to palladium [27,51]. In the present study, the chemical potential of the Pd thin films’ surface oxide layer was determined by anodic polarization of the films in the electrolyte, see the supplemental information for details. It ranges between −45and −80kJ/mol, depending on the degree of oxidation. Hence, the measured deep trap energies fall into the range of Pd oxide potentials. Furthermore, literature data for the adsorption energy of hydrogen atoms on clean Pd(111) surfaces are of a similar order of magnitude. Ferrin et al. and Dong et al. calculated H trapping energies of −46kJ/mol [53] (the values therein were corrected by −μ0H2/2) to −49kJ/mol [54] on Pd(111) surfaces. Conrad and Ertl et al. measured −44kJ/mol [55]. All of these energy values indicate the presence of deep traps at the Pd-H films surfaces. Additionally, hydrogen can be trapped in vacancies in the bulk of the films [18]. The trapping energy of Pd vacancies decorated with H-atoms changes with the number of trapped H. According to reference [56] the trapping energy is −22kJ/mol for one H atom, −45kJ/mol for two H atoms, and it decreases down to −112kJ/mol for six trapped H atoms. With this, it is improbable that vacancies widely contribute to hydrogen trapping in the investigated Pd-H thin films, since their filling should not saturate at two hydrogen atoms.
To evaluate the nature of the deep traps in more detail, the site fractions f2 given in Table 1 are compared to the number density of surface sites of Pd thin films. Owing to the Burgers vector b=0.275nm, the (111) surface plane of the Pd thin films consists of NS=2.54×10−9mol/cm2 Pd atoms. With the molar volume vPd=8.56×10−6m3/mol [27] of Pd, a 1cm2 film of 80nm thickness consists of NV=9.35×10−7mol Pd atoms in total. Hence, for this film NS/NV=0.0027. Surface atom fractions NS/NV of films with other thicknesses are listed in the last column of Table 1. Assuming that at maximum 1 H atom is adsorbed per Pd surface atom [55], NS/NV represents the maximum surface site fraction of H atoms on the films.
For all investigated films apart from 200nmnano crystalline Pd-H, Table 1 reveals f2<NS/NV. Thus, hydrogen adsorption to surface sites can explain the experimental findings. However, for most films a certain amount of surface sites seems to be blocked for hydrogen adsorption. For other surface sites, the natural surface oxide will be reduced by the formation of water molecules, which are dissolved in the electrolyte and open surface trap sites for H atoms. Thereby, the loss of hydrogen atoms by water formation in the electrochemical loading experiments results in an apparent lowering of the chemical potential in the plots of μH(xH) in Figures 3 and 4. The related effect will be three times that of direct H trapping on the Pd surface: Two hydrogen atoms bind to one surface oxygen atom, and a further hydrogen atom binds to the nascent surface site after dissolution of the generated water molecule. According to the values of f2, hydrogen trapping in vacancies, again, is of minor importance in the measured Pd-H thin film isotherms.
One can estimate the volume fraction v1 of grain/domain boundary sites in the Pd films, when the site fractions f1 are identified with the defects’ volume fraction in the metal [22,37]. This implies that each defect site has the partial volume v0 of an octahedral interstitial site, compare Eq 10. This is analogous to an attempt of Löffler et al. [49], who successfully described the contribution of disordered grain boundaries to X-ray scattering intensities of nano crystalline bulk Pd, assuming that the atom density of disordered grain boundaries matches that of the crystal lattice.
Nano crystalline thin films often consist of columnar grains, ranging from the top close to the bottom of the film [57]. The multi-oriented and the epitaxial Pd films investigated in this study consist of large domains [41,58], that can be described as columns, as well. Assuming columnar grains/domains with diameter D and grain/domain boundaries of width ∆, the grain boundary volume fraction is given as (Eq 18)
f1=v1=1−(DD+∆)2 | (18) |
With the established value of ∆=0.9nm for grain boundaries in nano crystalline bulk Pd [2,59] according mean grain/domain sizes were calculated and are listed in the left column of Table 2 for the different Pd-H films.
Thickness (nm) | DDomain (nm) O-sites in GB ∆=0.9nm (Eq 18) | DDomain (nm) T-sites in GB ∆=0.9nm (Eq 22) | |
Epitaxial Pd on 1 nm V/Al2O3 [0001] = 673 K | 24 | 24(1) | 50(4) |
80 | 95(9) | 192(21) | |
200 | 108(12) | 217(26) | |
Multi-oriented Pd on Al2O3 [0001], TDep = 673 K | 24 | 13(1) | 28(2) |
80 | 31(6) | 64(12) | |
200 | 55(18) | 111(35) | |
Nano crystalline Pd on Si [100], TDep = 300 K | 24 | 6(1) | 13(1) |
80 | 14(1) | 29(3) | |
200 | 17(2) | 35(4) |
The resulting grain/domains sizes are of a reasonable order of magnitude, but they are systematically too small compared to measured lateral grain/domain sizes of the films as determined by SEM. For the example of the 200nm nano crystalline Pd film a lateral grain size of 30−50nm was measured [41,57,58]. But, the domains were measured to span more than 100nm in the multi-oriented films and several hundred nm in the epitaxial films [41,57,58].
Considering this observation, different explanations are at hand. (ⅰ) first, the defect volume fractions might be over-estimated by Eq 14, if a significant kind of defect was neglected in Eq 10, for example dislocations. Another possible explanation might be linked to the assumption underlying Eq 18, e.g. that (ⅱ) the partial volume of grain boundary sites equals that of octahedral interstitial sites. Finally, (ⅲ) the adapted bulk grain boundary width ∆ might be too small for the thin films. These aspects are discussed subsequently.
To determine (ⅰ) the dislocation effect on the chemical potential of metal-hydrogen systems, the respective DOS of Eq 9 needs to be introduced into Eq 6. With a step-function approximation of the site occupancy, Kirchheim has shown that Eq 6 then yields the chemical potential contribution (Eq 19) [37].
μVH=EV−A⋅VH2(rρπxV)1/2 | (19) |
with the hydrogen concentration xV of dislocations.
If xV is not small, Eqs 6 with 9 needs to be integrated numerically. Both results are shown in Figure 8 for differently assumed dislocation densities ρ and compared to the data of the 80 nm nano crystalline Pd-H film. The hydride formation energy of the dislocations was set to EV=−20kJ/mol [37]. The dislocation densities were set to ρ=2×1011cm−2, which is typical for strongly deformed metals, and (for the plot) to ρ=30×1011cm−2.
Figure 8 shows that the film data are not represented by the curves for reasonable dislocation densities. An un-physically high dislocation density would be needed to approach the data. The reason is that the measured chemical potential of hydrogen in the Pd films increases much slower with the film’s hydrogen concentration than predicted by a primary dislocation effect, see the supplemental information. Hence, in the chemical potential of the solid solution regime of Pd-H thin films dislocations do not play a major role, and they can be neglected in the DOS evaluation.
Assuming the site fractions f1 to be correct, (ⅱ) a possibility to explain too small calculated grain/domain sizes D can be found in the geometry of the grain/domain boundary sites. Boundary sites with different character than octahedral (O)-sites might be occupied—such as tetrahedral (T)-sites. In the fcc lattice two T-sites exist per metal atom, while there is only one O-site per atom [3]. The DOS in Eq 10, however, represents the numbers fOi of sites replacing O-sites. Hence, assuming T-boundary sites, Eq 10 needs to be re-written (Eq 20):
Z(E)=(1−fT12−fO2)δ(E−E0)+fil0δ(E−Eil0)+fT1σ1√πexp(−(E−E1σ1)2)+ |
fO2σ2√πexp(−(E−E2σ2)2) | (20) |
with fT1=2⋅fO1˙=f1 in Table 1. We note that in principle only 50% of these T-sites (according to a maximum concentration of 1H/Pd) can be occupied by H atoms, since the nearest neighbour distance of the T-sites is 1.95 Å or 2.75 Å in the unit cell of palladium, respectively. The value of 1.95 Å is slightly smaller than Switendicks criterion for the minimum distance of 2.1 Å for neighbouring H atoms in the metal lattice due to a short ranged, repulsive electronic H-H interaction [59]. However, with a certain degree of disorder in the general grain/domain boundary fractions of the Pd thin films, one can assume that the positions of the T-sites are slightly distorted, making more T-sites available for hydrogen. Furthermore, in general it is not expected that the grain boundary sites are entirely occupied by H atoms, since the grain boundaries do not undergo hydride formation [22].
Since f1 is small, the consideration of T-sites does not significantly change the fitting parameters in Table 1. In case of the 80 nm nano crystalline Pd film E0 is reduced by 0.2kJ/mol, while the other fitting parameters remain constant. For most other films f1 is even smaller, yielding smaller corrections.
But, the change of the type of grain/domain boundary sites changes the volume density of domain boundaries in Eq 18, since (Eq 21)
v1=fO1=fT12=f12 | (21) |
yields (Eq 22)
fT1=2−2(DD+∆)2 | (22) |
for T-sites, when no restrictions apply for the T-site occupancy. Since ∆≪D, this scales up the lateral domain diameters D approximately by a factor of 2. The resulting domain sizes are listed in the right column of Table 2, as well. All domain sizes are plotted as a function of film thickness in Figure 9.
ⅲ) The third explanation could be a different grain boundary width ∆. According to Eq 22, the calculated grain/domain size D scales linearly with the geometrical boundary width ∆ (Eq 23),
D=∆⋅√2−fT1√2−√2−fT1 | (23) |
Hence, the grain/domain sizes would scale up, if the grain/domain boundary width ∆ were larger than expected. This might be interpreted by a certain underestimation of the grain boundary width ∆ for the nano crystalline bulk Pd in reference [22], taking the possible fraction of surplus atoms into account, that may block sites for hydrogen occupation at the grain boundaries. If this assumption were correct, the enhanced open-volume of the grain/domain boundaries of the thin films would deliver further arguments for a lowered site energy of grain/domain sites of Pd-H thin films compared to the nano crystalline bulk Pd-H grain boundaries.
In total, the fitted DOS and the resulting domain sizes suggest that H atoms are occupying T-sites in the domain boundaries of Pd thin films rather than O-sites. This suggestion matches the observed site occupancy in amorphous metals [14,38,42]. It fits to the proposition of partly amorphous intergranular phase fractions in the nano crystalline bulk as well as the Pd-H thin films. Additionally, the grain boundary width seems to be slightly larger than 0.9 nm.
The site energy distribution in Pd-H thin films can be successfully described by the proposed σDOS model which considers the substrate-induced stress impact as well as interstitial sites, grain boundary sites and deep trap sites for hydrogen. Within this σDOS model we can reveal information about the films’ microstructure.
This model is not restricted to Pd-H thin films, but it will be applicable to a variety of systems, where substrate-induced stresses and microstructural constituents significantly contribute to the site occupancy of solute atoms, that segregate to open-volume defects. This pure thermodynamic approach can supplement the microstructural analysis of alloy systems by other quantitative techniques, such as positron annihilation spectroscopy, neutron diffraction or transmission electron microscopy. This will be of high interest in the investigation of thin film metal-hydrogen systems containing special microstructural constituents of high content. Other examples are light elements such as carbon, nitrogen, oxygen or lithium in metals, but segregating metallic alloys such as bismuth in copper, as well.
Financial support of the Deutsche Forschungsgemeinschaft (DFG) via Projects PU131/7-2, PU131/9-1 and PU131/12-1 is gratefully acknowledged.
The authors declare no conflicts of interest in this paper.
[1] |
Y. LeCun, Y. Bengio, G. Hinton, Deep learning, Nature, 521 (2015), 436–444. doi: 10.1038/nature14539. doi: 10.1038/nature14539
![]() |
[2] | Google AI Blog, AlphaGo: Mastering the ancient game of Go with Machine Learning, 2016. Available from: https://ai.googleblog.com/2016/01/alphago-mastering-ancient-game-of-go.html. |
[3] | The 3rd Generation Partnership Project (3GPP). Available from: https://www.3gpp.org/specifications/specifications. |
[4] |
H. Yang, A. Alphones, Z. Xiong, D. Niyato, J. Zhao, K. Wu, Artificial-intelligence-enabled intelligent 6G networks, IEEE Network, 34 (2020), 272–280. doi: 10.1109/MNET.011.2000195. doi: 10.1109/MNET.011.2000195
![]() |
[5] |
A. Goldsmith, S. Chua, Adaptive coded modulation for fading channels, IEEE Trans. Commun., 46 (1998), 595–602. doi: 10.1109/26.668727. doi: 10.1109/26.668727
![]() |
[6] |
D. Gesbert, S. Kiani, A. Gjendemsjo, G. Oien, Adaptation, coordination, and distributed resource allocation in interference-limited wireless networks, Proc. IEEE, 95 (2007), 2393–2409. doi: 10.1109/JPROC.2007.907125. doi: 10.1109/JPROC.2007.907125
![]() |
[7] |
J. Lu, T. T. Tjhung, F. Adachi, C. L. Huang, BER performance of OFDM-MDPSK system in frequency-selective Rician fading with diversity reception, IEEE Trans. Veh. Technol., 49 (2000), 1216–1225. doi: 10.1109/25.875231. doi: 10.1109/25.875231
![]() |
[8] |
S. T. Chung, A. J. Goldsmith, Degrees of freedom in adaptive modulation: a unified view, IEEE Trans. Commun., 49 (2001), 1561–1571. doi: 10.1109/VETECS.2001.944588. doi: 10.1109/VETECS.2001.944588
![]() |
[9] |
D. Qiao, S. Choi, K. G. Shin, Goodput analysis and link adaptation for IEEE 802.11a wireless LANs, IEEE Trans. Mobile Comput., 1 (2002), 278–291. doi: 10.1109/TMC.2002.1175541 doi: 10.1109/TMC.2002.1175541
![]() |
[10] |
E. Peh, Y. Liang, Y. Guan, Y. Zeng, Optimization of cooperative sensing in cognitive radio networks: A sensing-throughput tradeoff view, IEEE Trans. Veh. Technol., 58 (2009), 5294–5299. doi: 10.1109/TVT.2009.2028030. doi: 10.1109/TVT.2009.2028030
![]() |
[11] |
G. Bianchi, Performance analysis of the IEEE 802.11 distributed coordination function, IEEE J. Sel. Areas Commun., 18 (2000), 535–547. doi: 10.1109/49.840210. doi: 10.1109/49.840210
![]() |
[12] |
J. Mitola, G. Q. Maguire, Cognitive radio: making software radios more personal, IEEE Pers. Commun., 6 (1999), 13–18. doi: 10.1109/98.788210. doi: 10.1109/98.788210
![]() |
[13] |
S. Haykin, Cognitive radio: Brain-empowered wireless communications, IEEE J. Sel. Areas Commun., 23 (2005), 201–220. doi: 10.1109/JSAC.2004.839380. doi: 10.1109/JSAC.2004.839380
![]() |
[14] |
M. G. Kibria, K. Nguyen, G. P. Villardi, O. Zhao, K. Ishizu, F. Kojima, Big data analytics, machine learning, and artificial intelligence in next-generation wireless networks, IEEE Access, 6 (2018), 32328–32338. doi: 10.1109/ACCESS.2018.2837692. doi: 10.1109/ACCESS.2018.2837692
![]() |
[15] |
M. Chen, U. Challita, W. Saad, C. Yin, M. Debbah, Artificial neural networks-based machine learning for wireless networks: A tutorial, IEEE Commun. Surv. Tutor., 21 (2019), 3039–3071. doi: 10.1109/COMST.2019.2926625. doi: 10.1109/COMST.2019.2926625
![]() |
[16] |
J. Wang, C. Jiang, H. Zhang, Y. Ren, K. -C. Chen, L. Hanzo, Thirty years of machine learning: The road to Pareto-optimal wireless networks, IEEE Commun. Surv. Tutor., 22 (2020), 1472–1514. doi: 10.1109/COMST.2020.2965856. doi: 10.1109/COMST.2020.2965856
![]() |
[17] |
M. Kulin, T. Kazaz, I. Moerman, E. De Poorter, End-to-end learning from spectrum data: A deep learning approach for wireless signal identification in spectrum monitoring applications, IEEE Access, 6 (2018), 18484–18501. doi: 10.1109/ACCESS.2018.2818794. doi: 10.1109/ACCESS.2018.2818794
![]() |
[18] |
C. Jiang, H. Zhang, Y. Ren, Z. Han, K. Chen, L. Hanzo, Machine learning paradigms for next-generation wireless networks, IEEE Wireless Commun., 24 (2017), 98–105. doi: 10.1109/MWC.2016.1500356WC. doi: 10.1109/MWC.2016.1500356WC
![]() |
[19] |
R. Li, Z. Zhao, X. Zhou, G. Ding, Y. Chen, Z. Wang, et al., Intelligent 5G: When cellular networks meet artificial intelligence, IEEE Wireless Commun., 24 (2017), 175–183. doi: 10.1109/MWC.2017.1600304WC. doi: 10.1109/MWC.2017.1600304WC
![]() |
[20] | T. M. Cover, J. A. Thomas, Elements of Information Theory, Wiley, 1991. |
[21] |
Z. M. Fadlullah, F. Tang, B. Mao, N. Kato, O. Akashi, T. Inoue, et al., State-of-the-art deep learning: Evolving machine intelligence toward tomorrow's intelligent network traffic control systems, IEEE Commun. Surv. Tutor., 19 (2017), 2432–2455. doi: 10.1109/COMST.2017.2707140. doi: 10.1109/COMST.2017.2707140
![]() |
[22] |
H. Ye, G. Y. Li, B. Juang, Power of deep learning for channel estimation and signal detection in OFDM systems, IEEE Wireless Commun. Lett., 7 (2018), 114–117. doi: 10.1109/LWC.2017.2757490. doi: 10.1109/LWC.2017.2757490
![]() |
[23] |
H. Huang, J. Yang, H. Huang, Y. Song, G. Gui, Deep learning for super-resolution channel estimation and DOA estimation based massive MIMO system, IEEE Trans. Veh. Technol., 67 (2018), 8549–8560. doi: 10.1109/TVT.2018.2851783. doi: 10.1109/TVT.2018.2851783
![]() |
[24] |
R. W. Ouyang, A. K. Wong, C. Lea, M. Chiang, Indoor location estimation with reduced calibration exploiting unlabeled data via hybrid generative/discriminative learning, IEEE Trans. Mob. Comput., 11 (2012), 1613–1626. doi: 10.1109/TMC.2011.193. doi: 10.1109/TMC.2011.193
![]() |
[25] |
Y. Chen, Q. Yang, J. Yin, X. Chai, Power-efficient access-point selection for indoor location estimation, IEEE Trans. Knowl. Data. Eng., 18 (2006), 877–888. doi: 10.1109/TKDE.2006.112. doi: 10.1109/TKDE.2006.112
![]() |
[26] |
S. Marano, W. M. Gifford, H. Wymeersch, M. Z. Win, NLOS identification and mitigation for localization based on UWB experimental data, IEEE J. Sel. Areas Commun., 28 (2010), 1026–1035. doi: 10.1109/JSAC.2010.100907. doi: 10.1109/JSAC.2010.100907
![]() |
[27] |
B. Mager, P. Lundrigan, N. Patwari, Fingerprint-based device-free localization performance in changing environments, IEEE J. Sel. Areas Commun., 33 (2015), 2429–2438. doi: 10.1109/JSAC.2015.2430515. doi: 10.1109/JSAC.2015.2430515
![]() |
[28] |
L. U. Khan, I. Yaqoob, M. Imran, Z. Han, C. S. Hong, 6G wireless systems: A vision, architectural elements, and future directions, IEEE Access, 8 (2020), 147029–147044. doi: 10.1109/ACCESS.2020.3015289. doi: 10.1109/ACCESS.2020.3015289
![]() |
[29] |
Y. He, C. Liang, F. R. Yu, Z. Han, Trust-based social networks with computing, caching and communications: A deep reinforcement learning approach, IEEE Trans. Network Sci. Eng., 7 (2020), 66–79. doi: 10.1109/TNSE.2018.2865183. doi: 10.1109/TNSE.2018.2865183
![]() |
[30] |
L. Li, Y. Xu, J. Yin, W. Liang, X. Li, W. Chen, Z. Han, Deep reinforcement learning approaches for content caching in cache-enabled D2D networks, IEEE Internet Things J., 7 (2020), 544–557. doi: 10.1109/JIOT.2019.2951509. doi: 10.1109/JIOT.2019.2951509
![]() |
[31] |
F. B. Mismar, B. L. Evans, A. Alkhateeb, Deep reinforcement learning for 5G networks: Joint beamforming, power control, and interference coordination, IEEE Trans. Commun., 68 (2020), 1581–1592. doi: 10.1109/TCOMM.2019.2961332. doi: 10.1109/TCOMM.2019.2961332
![]() |
[32] |
X. Fu, F. R. Yu, J. Wang, Q. Qi, J. Liao, Dynamic service function chain embedding for NFV-enabled IoT: A deep reinforcement learning approach, IEEE Trans. Wireless Commun., 19 (2020), 507–519. doi: 10.1109/TWC.2019.2946797. doi: 10.1109/TWC.2019.2946797
![]() |
[33] |
H. Huang, Y. Yang, H. Wang, Z. Ding, H. Sari, F. Adachi, Deep reinforcement learning for UAV navigation through massive MIMO technique, IEEE trans. Veh. Technol., 69 (2020), 1117–1121. doi: 10.1109/TVT.2019.2952549. doi: 10.1109/TVT.2019.2952549
![]() |
[34] |
Z. Zhang, H. Chen, M. Hua, C. Li, Y. Huang, L. Yang, Double coded caching in ultra dense networks: Caching and multicast scheduling via deep reinforcement learning, IEEE Trans. Commun., 68 (2020), 1071–1086. doi: 10.1109/TCOMM.2019.2955490. doi: 10.1109/TCOMM.2019.2955490
![]() |
[35] | H. Robbins, Some aspects of the sequential design of experiments, Bull. Amer. Math. Soc., 58 (1952), 527–535. |
[36] | L. Lai, H. E. Jiang, H. V. Poor, Medium access in cognitive radio networks: A competitive multi-armed bandit frame work, in Processing of IEEE 42th Asilomar Conference on Signals, System, and Computer (2008), 98–102. doi: 10.1109/ACSSC.2008.5074370. |
[37] |
L. Lai, H. E. Jiang, H. V. Poor, Cognitive medium access: Exploration, exploitation, and competition, IEEE Trans. Mobile Comput., 10 (2011), 239–253. doi: 10.1109/TMC.2010.65. doi: 10.1109/TMC.2010.65
![]() |
[38] |
S. Maghsudi, E. Hossain, Multi-armed bandits with application to 5G small cells, IEEE Wireless Commun., 23 (2016), 64–73. doi: 10.1109/MWC.2016.7498076. doi: 10.1109/MWC.2016.7498076
![]() |
[39] |
S. J. Kim, M. Aono, M. Hara, Tug-of-war model for the two-bandit problem: Nonlocally-correlated parallel exploration via resource conservation, Biosystems, 101 (2010), 29–36. doi: 10.1016/j.biosystems.2010.04.002. doi: 10.1016/j.biosystems.2010.04.002
![]() |
[40] |
Z. Zhao, E. Schiller, E. Kalogeiton, T. Braun, B. Stiller, M. T. Garip, et al., Autonomic communications in software-driven networks, IEEE J. Sel. Areas Commun., 35 (2017), 2431–2445. doi: 10.1109/JSAC.2017.2760354. doi: 10.1109/JSAC.2017.2760354
![]() |
[41] | Radio Spectrum Policy Group, Report on Collective Use of Spectrum and Other Sharing Approaches, 2011. Available from: https://rspg-spectrum.eu/wp-content/uploads/2013/05/rspg11_392_report_CUS_other_approaches_final.pdf. |
[42] | CEPT Electronic Communications Committee, ECC Report 205–Licensed Shared Access (LSA), 2014. Available from: http://spectrum.welter.fr/international/cept/ecc-reports/ecc-report-205-LSA-2300-MHz-2400-MHz.pdf. |
[43] | Reconfigurable Radio Systems (RRS), Information Elements and Protocols for the Interface between the LSA Controller (LC) and LSA Repository (LR) for the Operation of Licensed Shared Access (LSA) in the 2300 MHz–2400 MHz Band, 2017. Available from: https://www.etsi.org/deliver/etsi_ts/103300_103399/103379/01.01.01_60/ts_103379v010101p.pdf |
[44] |
S. Haykin, P. Setoodeh, S. Feng, D. Findlay, Cognitive dynamic system as the brain of complex networks, IEEE J. Sel. Areas Commun., 34 (2016), 2791–2800. doi: 10.1109/JSAC.2016.2605240. doi: 10.1109/JSAC.2016.2605240
![]() |
[45] |
M. Hasegawa, H. Hirai, K. Nagano, H. Harada, K. Aihara, Optimization for centralized and decentralized cognitive radio networks, Proc. IEEE, 102 (2014), 574–584. doi: 10.1109/JPROC.2014.2306255. doi: 10.1109/JPROC.2014.2306255
![]() |
[46] |
Y. Kon, K. Hashiguchi, M. Ito, M. Hasegawa, K. Ishizu, H. Murakami, et al., Autonomous throughput improvement scheme using machine learning algorithms for heterogeneous wireless networks aggregation, IEICE Trans. Commun., 95 (2012), 1143–1151. doi: 10.1587/transcom.E95.B.1143. doi: 10.1587/transcom.E95.B.1143
![]() |
[47] | IEEE, IEEE Standard for Architectural Building Blocks Enabling Network-Device Distributed Decision Making for Optimized Radio Resource Usage in Heterogeneous Wireless Access Networks, 2009. Available from: https://ieeexplore.ieee.org/document/4798288. |
[48] |
R. Combes, A. Proutiere, Dynamic rate and channel selection in cognitive radio systems, IEEE J. Sel. Areas Commun., 33 (2015), 910–921. doi: 10.1109/JSAC.2014.2361084. doi: 10.1109/JSAC.2014.2361084
![]() |
[49] |
D. Shiung, Y. Yang, Rate enhancement for cognitive radios using the relationship between transmission rate and signal-to-interference ratio statistics, IET Commun., 7 (2013). doi: 10.1049/iet-com.2013.0047. doi: 10.1049/iet-com.2013.0047
![]() |
[50] |
J. Lehtomaki, M. Benitez, K. Umebayashi, M. Juntti, Improved channel occupancy rate estimation, IEEE Trans. Commun., 63 (2015), 643–654. doi: 10.1109/TCOMM.2015.2402195. doi: 10.1109/TCOMM.2015.2402195
![]() |
[51] | B. E. Boser, I. M. Guyon, V. N. Vapnik, A training algorithm for optimal margin classifiers, in Proceedings of the fifth annual workshop on Computational learning theory, (1992), 144–152. doi: 10.1145/130385.130401. |
[52] | V. Vapnik, S. Golowich, A. Smola, Support vector method for function approximation, regression estimation, and signal processing, Adv. Neural Inf. Process. Syst., 1997 (1997), 281–287. |
[53] |
K. Oshima, T. Kobayashi, Y. Taenaka, K. Kuroda, M. Hasegawa, Wireless network optimization method based on cognitive cycle using machine learning, IEICE Commun. Express, 7 (2018), 278–283. doi: 10.1587/comex.2018XBL0061. doi: 10.1587/comex.2018XBL0061
![]() |
[54] | K. Oshima, T. Kobayashi, Y. Taenaka, K. Kuroda, M. Hasegawa, Autonomous wireless system optimization method based on cross-layer modeling using machine learning, in IEEE International Conference on Ubiquitous and Future Networks, (2019), 239–244. doi: 10.1109/ICUFN.2019.8806031. |
[55] | J. Kennedy, R. Eberhart, Particle swarm optimization, in Proceedings of ICNN'95-International Conference on Neural Networks, 4 (1995), 1942–1948. doi: 10.1109/ICNN.1995.488968. |
[56] |
V. Kadirkamanathan, K. Selvarajah, P. J. Fleming, Stability analysis of the particle dynamics in particle swarm optimizer, IEEE Trans. Evol. Comput., 10 (2006), 245–255. doi: 10.1109/TEVC.2005.857077. doi: 10.1109/TEVC.2005.857077
![]() |
[57] | Scalable Network Technologies, Inc., Available from: https://www.scalable-networks.com. |
[58] | Beyond 5G/6G White Paper, National Institute of Information and Communications Technology, 2021. Available from: https://beyond5g.nict.go.jp/en/download/index.html. |
[59] |
P. V. R. Ferreira, R. Paffenroth, A. M. Wyglinski, T. M. Hackett, S. G. Bilen, R. C. Reinhart, et al., Multiobjective reinforcement learning for cognitive satellite communications using deep neural network ensembles, IEEE J. Sel. Areas Commun., 36 (2018). doi: 10.1109/JSAC.2018.2832820. doi: 10.1109/JSAC.2018.2832820
![]() |
[60] | N. Cardwell, Y. Cheng, C. S. Gunn, S. H. Yeganeh, V. Jacobson, BBR: congestion-based congestion control, ACM Queue, 14 (2016), 20–53. |
[61] |
H. Yang, Z. Xiong, J. Zhao, D. Niyato, Q. Wu, L. Xiao, Deep reinforcement learning-based intelligent reflecting surface for secure wireless communications, IEEE Trans. Wireless Commun., 20 (2021), 375–388. doi: 10.1109/TWC.2020.3024860. doi: 10.1109/TWC.2020.3024860
![]() |
[62] |
K. Oshima, T. Onishi, S. J. Kim, J. Ma, M. Hasegawa, Efficient wireless network selection by using multi-armed bandit algorithm for mobile terminals, Nonlinear Theory Its Appl. IEICE, 11 (2020), 68–77. doi: 10.1587/nolta.11.68. doi: 10.1587/nolta.11.68
![]() |
[63] | R. Sutton, A. Barto, Reinforcement Learning: An Introduction, The MIT Press, 1998. |
[64] |
N. D. Daw, J. P. O'doherty, P. Dayan, B. Seymour, R. J. Dolan, Cortical substrates for exploratory decisions in humans, Nature, 441 (2006), 876–879. doi: 10.1038/nature04766. doi: 10.1038/nature04766
![]() |
[65] |
P. Auer, N. Cesa-Bianchi, P. Fischer, Finite-time analysis of the multiarmed bandit problem, Mach. Learn., 47 (2002), 235–256. doi: 10.1023/A:1013689704352. doi: 10.1023/A:1013689704352
![]() |
[66] |
S. J. Kim, M. Aono, Amoeba-inspired algorithm for cognitive medium access, NOLTA, 5 (2014), 198–209. doi: 10.1587/nolta.5.198. doi: 10.1587/nolta.5.198
![]() |
[67] |
S. J. Kim, M. Aono, E. Nameda, Efficient decision-making by volume-conserving physical object, New J. Phys., 17 (2015). doi: 10.1088/1367-2630/17/8/083023. doi: 10.1088/1367-2630/17/8/083023
![]() |
[68] |
S. J. Kim, M. Aono, E. Nameda, Decision maker based on atomic switches, AIMS Mater. Sci., 3 (2016), 245–259. doi: 10.3934/matersci.2016.1.245. doi: 10.3934/matersci.2016.1.245
![]() |
[69] |
J. Ma, S. Hasegawa, S. J. Kim, M. Hasegawa, A reinforcement-learning-based distributed resource selection algorithm for massive IoT, Appl. Sci., 9 (2019). doi: 10.3390/app9183730. doi: 10.3390/app9183730
![]() |
[70] |
H. Yang, Z. Xiong, J. Zhao, D. Niyato, Q. Wu, H. V. Poor, et al., Intelligent reflecting surface assisted anti-jamming communications: A fast reinforcement learning approach, IEEE Trans. Wireless Commun., 20 (2021), 1963–1974. doi: 10.1109/TWC.2020.3037767. doi: 10.1109/TWC.2020.3037767
![]() |
[71] |
S. Singh, J. G. Andrews, Joint resource partitioning and offloading in heterogeneous cellular networks, IEEE Trans. Wireless Commun., 13 (2014), 888–901. doi: 10.1109/TWC.2013.120713.130548. doi: 10.1109/TWC.2013.120713.130548
![]() |
[72] |
C. Liu, M. Li, S. V. Hanly, P. Whiting, Joint downlink user association and interference management in two-tier HetNets with dynamic resource partitioning, IEEE Trans. Veh. Technol., 66 (2017), 1365–1378. doi: 10.1109/TVT.2016.2565538. doi: 10.1109/TVT.2016.2565538
![]() |
[73] |
V. Sagar, R. Chandramouli, K. P. Subbalakshmi, Software defined access for HetNets, IEEE Commun. Mag., 54 (2016), 84–89. doi: 10.1109/MCOM.2016.7378430. doi: 10.1109/MCOM.2016.7378430
![]() |
[74] |
A. Keshavarz-Haddad, E. Aryafar, M. Wang, M. Chiang, HetNets selection by clients: Convergence efficiency and practicality, IEEE/ACM Trans. Netw., 25 (2017), 406–419. doi: 10.1109/TNET.2016.2587622. doi: 10.1109/TNET.2016.2587622
![]() |
[75] | E. Aryafar, A. Keshavarz-Haddad, M. Wang, M. Chiang, RAT selection games in HetNets, in 2013 Proceedings IEEE INFOCOM, (2013), 998–1006. doi: 10.1109/INFCOM.2013.6566889. |
[76] |
X. Wang, J. Li, L. Wang, C. Yang, Z. Han, Intelligent user-centric network selection: A model-driven reinforcement learning framework, IEEE Access, 7 (2019), 21645–21661. doi: 10.1109/ACCESS.2019.2898205. doi: 10.1109/ACCESS.2019.2898205
![]() |
[77] |
D. D. Nguyen, H. X. Nguyen, L. B. White, Reinforcement learning with network-assisted feedback for heterogeneous RAT selection, IEEE Trans. Wireless Commun., 19 (2017). doi: 10.1109/TWC.2017.2718526. doi: 10.1109/TWC.2017.2718526
![]() |
[78] |
K. Kuroda, H. Kato, S. J. Kim, M. Naruse, M. Hasegawa, Improving throughput using multi-armed bandit algorithm for wireless LANs, NOLTA, 9 (2018), 74–81. doi: 10.1587/nolta.9.74. doi: 10.1587/nolta.9.74
![]() |
[79] | ns-3, ns-3: A Discrete-event Network Simulator for Internet Systems, Available from: https://www.nsnam.org/. |
[80] |
S. Takeuchi, M. Hasegawa, K. Kanno, A. Uchida, N. Chauvet, M. Naruse, Dynamic channel selection in wireless communications via a multi-armed bandit algorithm using laser chaos time series, Sci. Rep., 10 (2020). doi: 10.1038/s41598-020-58541-2. doi: 10.1038/s41598-020-58541-2
![]() |
[81] | H. Kanemasa, A. Li, M. Naruse, N. Chauvet, M. Hasegawa, Dynamic channel bonding using laser chaos decision maker in WLANs, 2021 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), (2021), 078–082. doi: 10.1109/ICAIIC51459.2021.9415227. |
[82] | Z. Duan, N. Okada, A. Li, M. Naruse, N. Chauvet, M. Hasegawa, High-speed optimization of user pairing in NOMA system using laser chaos based MAB algorithm, 2021 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), (2021), 073–077. doi: 10.1109/ICAIIC51459.2021.9415234. |
1. | Jens Möllmer, Hans Uhlig, Marcus Lange, Jörg Hofmann, Andrei L. Kolesnikov, Yury A. Budkov, André Götze, Holger Kohlmann, Thermodynamics of hydrogen sorption in MgPd2, 2021, 859, 09258388, 157782, 10.1016/j.jallcom.2020.157782 | |
2. | Wang Liu, Yann Magnin, Daniel Förster, Julie Bourgon, Thomas Len, Franck Morfin, Laurent Piccolo, Hakim Amara, Claudia Zlotea, Size-dependent hydrogen trapping in palladium nanoparticles, 2021, 2050-7488, 10.1039/D0TA12174F | |
3. | Raju Lipin, Apinya Ngoipala, Ryan Lacdao Arevalo, Matthias Vandichel, Computational surface Pourbaix diagrams to unravel cathodic hydride formation on defective palladium surfaces, 2024, 61, 03603199, 460, 10.1016/j.ijhydene.2024.02.248 | |
4. | Astrid Pundt, Stefan Wagner, Hydrogen Interactions with Defects in Materials, 2024, 96, 0009-286X, 182, 10.1002/cite.202300235 | |
5. | Svetlana Korneychuk, Stefan Wagner, Darius Rohleder, Philipp Vana, Astrid Pundt, Local Hydrogen Concentration and Distribution in Pd Nanoparticles: An In Situ STEM‐EELS Approach, 2024, 1613-6810, 10.1002/smll.202407092 |
Thickness (nm) | E0 (kJ/mol) | Eil0 (kJ/mol) | E1 (kJ/mol) | σ1 (kJ/mol) | f1 | E2 (kJ/mol) | σ2 (kJ/mol) | f2 | NSNV | |
Epitaxial Pd on 1 nm V/Al2O3 [0001], TDep = 673 K | 24 | 4.6(3) | -0.8(5) | 0.6(1) | 17.9(3) | 0.070(2) | -43(1) | 11.3(3) | 0.0019(1) | 0.0091 |
80 | 5.7(3) | -0.3(9) | 0.6(1) | 19.3(3) | 0.019(2) | -43(1) | 8.1(3) | 0.0007(1) | 0.0027 | |
200 | 4.8(3) | -0.3(9) | 0.5(1) | 17.1(5) | 0.017(2) | -42(1) | 8.1(3) | 0.0002(1) | 0.0011 | |
Multi-oriented Pd on Al2O3 [0001], TDep = 673 K | 24 | 1.8(3) | n/a | 0.5(1) | 15.3(3) | 0.124(2) | -46(1) | 9.4(3) | 0.003(1) | 0.0091 |
80 | 4.4(3) | n/a | 0.5(1) | 16.6(3) | 0.055(2) | -45(1) | 5.6(3) | 0.0013(1) | 0.0027 | |
200 | 4.5(3) | n/a | 0.5(1) | 17.4(3) | 0.032(2) | -42(1) | 8.1(3) | 0.0005(1) | 0.0011 | |
Nano crystalline Pd on Si [100], TDep = 300 K | 24 | 1.0(3) | n/a | 0.5(1) | 14.5(3) | 0.25(2) | -44.0(5) | 5.9(3) | 0.003(1) | 0.0091 |
80 | 1.5(3) | n/a | 0.5(1) | 15.0(3) | 0.118(2) | -48.3(5) | 6.3(3) | 0.0021(1) | 0.0027 | |
200 | 1.0(3) | n/a | 0.7(1) | 14.5(3) | 0.100(2) | -48.0(5) | 7.1(3) | 0.0015(1) | 0.0011 | |
Reference: coarse grained [10,32] and nano crystalline [22] bulk Pd | bulk | 4.7-7.7 | n/a | n/a | n/a | n/a | - | - | - | 5.5 × 10−6 |
nc bulk | 3.9 | n/a | 9.2 | 15 | 0.3 | - | - | - | 5.5 × 10−6 |
Thickness (nm) | DDomain (nm) O-sites in GB ∆=0.9nm (Eq 18) | DDomain (nm) T-sites in GB ∆=0.9nm (Eq 22) | |
Epitaxial Pd on 1 nm V/Al2O3 [0001] = 673 K | 24 | 24(1) | 50(4) |
80 | 95(9) | 192(21) | |
200 | 108(12) | 217(26) | |
Multi-oriented Pd on Al2O3 [0001], TDep = 673 K | 24 | 13(1) | 28(2) |
80 | 31(6) | 64(12) | |
200 | 55(18) | 111(35) | |
Nano crystalline Pd on Si [100], TDep = 300 K | 24 | 6(1) | 13(1) |
80 | 14(1) | 29(3) | |
200 | 17(2) | 35(4) |
Thickness (nm) | E0 (kJ/mol) | Eil0 (kJ/mol) | E1 (kJ/mol) | σ1 (kJ/mol) | f1 | E2 (kJ/mol) | σ2 (kJ/mol) | f2 | NSNV | |
Epitaxial Pd on 1 nm V/Al2O3 [0001], TDep = 673 K | 24 | 4.6(3) | -0.8(5) | 0.6(1) | 17.9(3) | 0.070(2) | -43(1) | 11.3(3) | 0.0019(1) | 0.0091 |
80 | 5.7(3) | -0.3(9) | 0.6(1) | 19.3(3) | 0.019(2) | -43(1) | 8.1(3) | 0.0007(1) | 0.0027 | |
200 | 4.8(3) | -0.3(9) | 0.5(1) | 17.1(5) | 0.017(2) | -42(1) | 8.1(3) | 0.0002(1) | 0.0011 | |
Multi-oriented Pd on Al2O3 [0001], TDep = 673 K | 24 | 1.8(3) | n/a | 0.5(1) | 15.3(3) | 0.124(2) | -46(1) | 9.4(3) | 0.003(1) | 0.0091 |
80 | 4.4(3) | n/a | 0.5(1) | 16.6(3) | 0.055(2) | -45(1) | 5.6(3) | 0.0013(1) | 0.0027 | |
200 | 4.5(3) | n/a | 0.5(1) | 17.4(3) | 0.032(2) | -42(1) | 8.1(3) | 0.0005(1) | 0.0011 | |
Nano crystalline Pd on Si [100], TDep = 300 K | 24 | 1.0(3) | n/a | 0.5(1) | 14.5(3) | 0.25(2) | -44.0(5) | 5.9(3) | 0.003(1) | 0.0091 |
80 | 1.5(3) | n/a | 0.5(1) | 15.0(3) | 0.118(2) | -48.3(5) | 6.3(3) | 0.0021(1) | 0.0027 | |
200 | 1.0(3) | n/a | 0.7(1) | 14.5(3) | 0.100(2) | -48.0(5) | 7.1(3) | 0.0015(1) | 0.0011 | |
Reference: coarse grained [10,32] and nano crystalline [22] bulk Pd | bulk | 4.7-7.7 | n/a | n/a | n/a | n/a | - | - | - | 5.5 × 10−6 |
nc bulk | 3.9 | n/a | 9.2 | 15 | 0.3 | - | - | - | 5.5 × 10−6 |
Thickness (nm) | DDomain (nm) O-sites in GB ∆=0.9nm (Eq 18) | DDomain (nm) T-sites in GB ∆=0.9nm (Eq 22) | |
Epitaxial Pd on 1 nm V/Al2O3 [0001] = 673 K | 24 | 24(1) | 50(4) |
80 | 95(9) | 192(21) | |
200 | 108(12) | 217(26) | |
Multi-oriented Pd on Al2O3 [0001], TDep = 673 K | 24 | 13(1) | 28(2) |
80 | 31(6) | 64(12) | |
200 | 55(18) | 111(35) | |
Nano crystalline Pd on Si [100], TDep = 300 K | 24 | 6(1) | 13(1) |
80 | 14(1) | 29(3) | |
200 | 17(2) | 35(4) |