We introduce the general notion of a rank on a vector space, which includes both tensor rank and conventional matrix rank, but incorporates other examples as well. Extending this concept, we investigate vector spaces consisting of vectors with a lower bound on their rank. Our main result shows that bases for such spaces of maximum dimension can be chosen to consist exclusively of vectors of minimal rank. This generalization extends the results of [
Citation: Zoran Z. Petrović, Zoran S. Pucanović, Marko D. Pešović, Miloš A. Kovačević. Some insights into rank conditions of vector subspaces[J]. AIMS Mathematics, 2024, 9(9): 23711-23723. doi: 10.3934/math.20241152
[1] | Ruiping Wen, Tingyan Liu, Yalei Pei . A new algorithm by embedding structured data for low-rank tensor ring completion. AIMS Mathematics, 2025, 10(3): 6492-6511. doi: 10.3934/math.2025297 |
[2] | Xinyu Qi, Jinru Wang, Jiating Shao . Minimax perturbation bounds of the low-rank matrix under Ky Fan norm. AIMS Mathematics, 2022, 7(5): 7595-7605. doi: 10.3934/math.2022426 |
[3] | J. Alberto Conejero, Antonio Falcó, María Mora–Jiménez . A pre-processing procedure for the implementation of the greedy rank-one algorithm to solve high-dimensional linear systems. AIMS Mathematics, 2023, 8(11): 25633-25653. doi: 10.3934/math.20231308 |
[4] | Jiao Xu, Hairui Zhang, Lina Liu, Huiting Zhang, Yongxin Yuan . A unified treatment for the restricted solutions of the matrix equation AXB=C. AIMS Mathematics, 2020, 5(6): 6594-6608. doi: 10.3934/math.2020424 |
[5] | Ramses van der Toorn . Elementary properties of non-Linear Rossby-Haurwitz planetary waves revisited in terms of the underlying spherical symmetry. AIMS Mathematics, 2019, 4(2): 279-298. doi: 10.3934/math.2019.2.279 |
[6] | Álvaro Antón-Sancho . The C∗-action and stratifications of the moduli space of semi-stable Higgs bundles of rank 5. AIMS Mathematics, 2025, 10(2): 3428-3456. doi: 10.3934/math.2025159 |
[7] | Fan Sha, Jianbing Zhang . Randomized symmetric Gauss-Seidel method for solving linear least squares problems. AIMS Mathematics, 2024, 9(7): 17453-17463. doi: 10.3934/math.2024848 |
[8] | Ruiping Wen, Wenwei Li . An accelerated alternating directional method with non-monotone technique for matrix recovery. AIMS Mathematics, 2023, 8(6): 14047-14063. doi: 10.3934/math.2023718 |
[9] | Sharifeh Soofizadeh, Reza Fallahnejad . Evaluation of groups using cooperative game with fuzzy data envelopment analysis. AIMS Mathematics, 2023, 8(4): 8661-8679. doi: 10.3934/math.2023435 |
[10] | Vasilii Zaitsev, Inna Kim . Arbitrary finite spectrum assignment and stabilization of bilinear systems with multiple lumped and distributed delays in state. AIMS Mathematics, 2025, 10(3): 6934-6951. doi: 10.3934/math.2025317 |
We introduce the general notion of a rank on a vector space, which includes both tensor rank and conventional matrix rank, but incorporates other examples as well. Extending this concept, we investigate vector spaces consisting of vectors with a lower bound on their rank. Our main result shows that bases for such spaces of maximum dimension can be chosen to consist exclusively of vectors of minimal rank. This generalization extends the results of [
Research on linear matrix spaces of matrices with bounded rank has a rich history and continues to be an active area of investigation, driven by both theoretical developments and practical applications across various disciplines. For any positive integer k⩽min{m,n}, three interesting types of subspaces exist within the space of m×n real matrices. These include subspaces where the rank of each matrix is bounded above by k, subspaces where the rank of each non-zero matrix is at least k, and subspaces consisting of matrices with a fixed rank k and a zero matrix, referred to as k-spaces of matrices. The study of matrices with a bounded rank dates back to the early days of linear algebra, with expanding applications across disciplines.
One of the initial breakthroughs in this field is the determination of the maximum possible dimension of a subspace consisting of real n×n full-rank matrices (i.e., a subspace in which every non-zero matrix is invertible), known as the Radon-Hurwitz number [20,37]. This corresponds to the problem of vector fields on spheres, as noted by J. F. Adams [1]. E. G. Rees [38] showed that for each k, where 0<k<m⩽n, there exist linear subspaces of real n×m matrices with dimensions (m−k)(n−k), in which every non-zero matrix has a rank of at least k. K. Y. Lam and P. Yiu [26] determined the largest possible dimensions of linear spaces consisting of real n×n matrices with fixed ranks of n−1 or n−2, using topological K-theory. For further exploration, we recommend papers [3,13,22,27,31,40] for various results in this field.
Of particular interest is the paper by Handel [15], investigating subspaces of the tensor product of two finite-dimensional vector spaces V⊗W that do not contain rank-1 tensors. This corresponds to the existence of non-singular bilinear maps. Determining the minimum possible dimension of the vector space U for which there exists a vector space homomorphism f:V⊗W→U such that:
f(v⊗w)=0⟹v=0orw=0 |
is equivalent to finding a subspace of maximum dimension M that does not contain rank-1 matrices. When the underlying field is the field of real numbers, the existence of non-singular bilinear maps has important applications in topology. Handel's paper presents two important results. First, he showed that maximal subspaces meeting the specified condition possess bases consisting only of elements with ranks two and three. This result was crucial in establishing his second main result: the existence of subspaces with maximum dimension that satisfy the aforementioned condition and have a basis consisting exclusively of rank-2 tensors. Expanding on Handel's work in [36] (see also [35]), the author generalized these results to include cases where the subspaces do not contain non-zero matrices with a rank less than the specified number. The author showed the existence of a subspace of maximum dimension consisting entirely of matrices having rank k or higher (for any given k⩾2), together with the zero matrix, which has a basis consisting only of rank k matrices. Corresponding results related to the spaces of symmetric and skew-symmetric matrices were also discussed.
The paper is structured as follows: In Section 2, we revisit the notions of tensor rank and CP decomposition, due to their fundamental importance. Section 3 introduces a general rank function applicable to all vector spaces and provides some simple examples. As far as we know, this rank function does not appear elsewhere in the existing literature. Section 4 investigates subspaces with rank conditions and generalizes results from [36]. The proofs closely resemble those in the aforementioned paper, as we distilled from the usual tensor rank what is necessary to make our proofs go through. Section 5 presents several more advanced examples. Finally, in Section 6, we point out that our rank function is not related to rank functions arising in Strassen's works on asymptotic spectra.
This section introduces basic concepts related to tensor rank and CP decomposition. Let F denote a field, and V1,V2,…,Vn be F-vector spaces. A non-zero tensor t∈V1⊗V2⊗⋯⊗Vn is rank-one if it can be written as v1⊗v2⊗⋯⊗vn, where vj∈Vj for j=1,…,n.
The rank of the zero tensor is defined to be zero. Clearly, each tensor admits a decomposition into a sum of k rank-1 tensors with a corresponding non-negative integer k.
Definition 1. The rank of a tensor t∈V1⊗V2⊗⋯⊗Vn, denoted by rank(t), is the minimal number r of rank-1 tensors needed to express t as a sum:
t=r∑i=1vi1⊗vi2⊗⋯⊗vin,vij∈Vj,j=1,…,n. | (2.1) |
The CP decomposition (2.1), introduced by Hitchcock [18,19], represents t as a sum of rank-one tensors, and is also known as CANDECOMP/PARAFAC [6,16].
For an n-th order tensor t of size m1×m2×⋯×mn, the CP decomposition (2.1) can be equivalently expressed as
t=[[U1,U2,…,Un]], | (2.2) |
where Uj∈Rmj×r.
Difficulties in tensor rank research include the lack of efficient algorithms for determining the rank of tensors when n>2 [17] and variations in rank based on the underlying field [25].
Uniqueness in tensor decomposition, as shown by Kruskal's criteria, demonstrates distinct properties of tensor rank compared to matrices [24,39,41]. It may seem unexpected that higher-order tensors show an advantage in this regard. While the decomposition of matrices into a sum of rank-1 matrices lacks uniqueness, higher-order tensors generally possess a unique CP decomposition (up to permutations and scalings) under relatively mild conditions. To establish uniqueness criteria, Kruskal introduced the concept of a k-rank, indicating the largest number k such that every k vector in the vector collection {v1,…,vn} is linearly independent, or equivalently, the largest number k such that dim(span{vi1,…,vik})=k for any subset of k vectors. If
kj=k-rank({vj1,vj2,…,vjr}),j=1,…,n, where n⩾3, |
then, according to Kruskal's theorem, a sufficient condition for the uniqueness of the CP decomposition (2.1) is given by:
n∑j=1kj⩾2r+n−1. | (2.3) |
For recent advances in the generalization of Kruskal's theorem, we recommend consulting [10,14,28].
Various concepts related to tensor ranks, such as symmetric rank, border rank, and Schmidt rank, among others, are actively researched [7,8,11,33]. In addition, new concepts have recently been introduced, which will be discussed in more detail in Section 5.
For detailed discussions of tensor rank properties, we recommend the paper by T. Kolda and B. Bader [23], and for applications in quantum information theory, Bruzda et al. [4].
While higher-order tensors represent a natural extension of matrices, their rank properties exhibit distinct characteristics. In this paper, we demonstrate that certain properties related to matrix spaces, originally established in the paper by Z. Petrović [36], can be extended to higher-order tensor spaces.
At the end of this section, let us consider the following example:
Example 1. Consider the positive integer k⩾2 and the real vector spaces V1, V2, and V3 of dimensions m, n, and p, respectively. Assume m=sk, where s is a positive integer, and m<n<p. Choose any set of linearly independent vectors (e.g., standard basis vectors) {u1,…,um}⊂V1, {v1,…,vn}⊂V2, and {w1,…,wp}⊂V3. Define the tensors:
tl=lk∑j=(l−1)k+1uj⊗vj⊗wj,l=1,…,s. | (2.4) |
The set {uj⊗vj⊗wj:1⩽j⩽m} contains linearly independent tensors due to the linear independence of the respective vectors in V1, V2, and V3. Furthermore, tl is a rank-k tensor. Since k⩾2, Kruskal's condition (2.3) ensures unique CP decompositions for tl. It follows that
span{t1,t2,…,ts} |
represents a tensor subspace where every non-zero tensor has a rank of at least k.
Remark. Note that the tensors tl are actually diagonal tensors with frontal slices Eij=[δij], where δij is the Kronecker delta, i,j=(l−1)k+1,…,lk. Visualizing them as third-order tensors, they resemble cuboids with frontal slices Eij.
Let us first revisit an example from [35]. Consider m×n matrices (assuming m⩽n) of the following form:
[0⋯0x1x2⋯⋯xn−k+10⋯x1x2⋯⋯xn−k+10⋮⋮⋮⋮⋮⋮⋮⋮x1x2⋯⋯⋯xn−k+1⋯000⋯⋯⋯0⋯0⋮⋮⋮⋮⋮⋮⋮⋮00⋯⋯⋯0⋯0] |
Except when x1=⋯=xn−k+1=0, these matrices all have rank k. Thus, the lower bound on the maximum dimension of subspaces generated by m×n matrices with fixed rank k is at least max{m,n}−k+1. Determining the maximum possible dimensions of such spaces involves various techniques from algebraic topology and algebraic geometry. However, these methods do not readily extend to higher-order tensors.
Motivated by the results from [36], we propose a rank function that can be applied to any vector space.
Definition 2. Let V be an arbitrary vector space over the field F, and let N denote the set of non-negative integers. A numerical function ρ:V→N is called a rank function if it satisfies the following conditions:
(1) ρ(v)=0 if and only if v=0.
(2) ρ(αv)=ρ(v) for all α∈F∖{0}.
(3) ρ(v+w)⩽ρ(v)+ρ(w) for all v,w∈V.
(4) If ρ(v)=k, there exists v1,…,vk∈V such that v=v1+⋯+vk and ρ(vi)=1, i=1,…,k.
Proposition 1. Let V be an arbitrary vector space and ρ a rank function on V. Then ρ(v) is the smallest number k such that v=v1+⋯+vk, where ρ(vi)=1 for all i. If we have two rank functions ρ1 and ρ2 satisfying these conditions, and if for all v∈V, ρ1(v)=1 if and only if ρ2(v)=1, then ρ1(v)=ρ2(v) for all v∈V.
Proof. The first statement follows immediately from conditions (3) and (4). Suppose ρ(v)=k. By condition (4), v can be expressed as a sum of k vectors of rank 1. If v could also be expressed as v=w1+⋯+wl with l<k and ρ(wi)=1 for all i, then by condition (3), we would have ρ(v)≤l<k. This contradicts ρ(v)=k, so v must indeed be expressible as a sum of k rank 1 vectors.
Therefore, the rank function is completely determined once we know which vectors have rank 1, and the second statement follows.
Such rank functions do indeed exist. We present a few examples here; additional examples will be presented in Section 5. The simplest yet crucial one for our purposes is the following:
Example 2. If V is a space consisting entirely of tensors of a certain order, the usual tensor rank serves as a rank function.
We can also construct rank functions on a general vector space in a straightforward manner.
Example 3. Let V be an arbitrary vector space over a field F. Take any basis of V, and define ρ(v)=k if and only if v is a linear combination of k elements of this basis with non-zero coefficients.
This example illustrates that there exist infinitely many rank functions on a given vector space. It is straightforward to check that a function defined in this manner satisfies all the conditions specified in Definition 2. Note that this rank function does not coincide with the usual rank if the elements of V are tensors.
Example 4. For a field F and V=F[X1,…,Xn], the previous example provides us with a rank function ρ, where ρ(p) counts the monomials appearing in the polynomial p∈V.
It depends on the structure of elements in a particular vector space which other rank functions one may introduce. For example, in the space of skew-symmetric matrices of a given order over fields of characteristic not equal to 2, the most natural rank function is half of the usual rank (since the usual rank of skew-symmetric matrices is an even number).
It is noteworthy that rank functions exhibit a rather important property derived from conditions (3) and (4):
Proposition 2. If ρ(v)=l>1 and 1⩽k<l, then there exist vectors w and w′ such that:
ρ(w)=k,ρ(w′)=l−k,andv=w+w′. |
Proof. This can be easily proved using Definition 2. We have v=v1+⋯+vl for some vectors vi such that ρ(vi)=1 for all i. If we take w=v1+⋯+vk and w′=vk+1+⋯+vk (in that order), we observe that according to the third condition:
v=w+w′,ρ(w)⩽k, andρ(w′)⩽l−k. |
Moreover, if ρ(w)<k or ρ(w′)<l−k, condition (3) would imply that ρ(v)<l. Thus, the proposition is established.
Let us rephrase the fundamental notion of an unshrinkable basis by Handel [15, Definition 2.1].
Definition 3. Let V be a vector space with a rank function ρ, W be a subspace of V, and e=[v1,…,vr] be a basis of W. Define:
ρ(e):=∑iρ(vi). |
Then e is called unshrinkable if ρ(e)=min{ρ(e′):e′ is a basis of W}. If e is an unshrinkable basis satisfying ρ(v1)⩽⋯⩽ρ(vr), it is called a sorted unshrinkable basis. We define ρ(W) to be min{ρ(v):v∈W,v≠0}.
These bases always exist and they have useful properties (cf. [15, Lemmas 2.3 and 2.4]), one of which is crucial for this paper, expressed through the rank function ρ:
Lemma 1. For an unshrinkable basis e=[v1,…,vm] of W, we have:
ρ(∑iαivi)⩾max{ρ(vi)∣αi≠0}. |
Proof. Suppose ρ(∑iαivi)<ρ(vj) for some j where αj≠0. If we replace vj with ∑iαivi in our basis e, while keeping the other vectors unchanged, we obtain another basis e′. Since αj≠0, vj is a linear combination of vectors from e′, ensuring e′ is indeed a basis. However, this new basis e′ has
ρ(e′)<ρ(e), |
which contradicts the fact that e is unshrinkable.
We are now ready to state the main results.
Theorem 1. Let k⩾2 be an integer and W a subspace of a finite-dimensional vector space V equipped with the rank function ρ. Suppose W is maximal among those subspaces W′ with ρ(W′)=k. Let [v1,…,vs] be an unshrinkable basis of W. Then, for all i=1,…,s, we have:
k⩽ρ(vi)⩽3k−3. |
Proof. Consider a subspace U of W spanned by all vi's such that k⩽ρ(vi)⩽3k−3.
We claim that W=U. Assume, to the contrary, that W≠U and let x∈W∖U. By Lemma 1, we have ρ(x)>3k−3. To establish W=U, we construct an epimorphism f:V→V/U with kernel W. This proves dimW=dimU, hence W=U.
Let x∈V. We want to show that there exist y∈W and z∈V such that ρ(z)<k and x=y+z.
If x∈W, then we can take y=x and z=0.
Let x∈V∖W. Since W is maximal among those subspaces W′ with ρ(W′)=k, the subspace spanned by W and x must contain a vector z1 with ρ(z1)<k. Thus, there exist z1 and y1 such that
z1=αx+y1, |
where ρ(z1)<k, y1∈W, and α∈F. Since z1∉W, α≠0, and we conclude that x can be expressed as
x=y+z,y∈W,ρ(z)<k. |
If x=y′+z′ is another such expression for x, then
z−z′=y′−y∈W, |
and
ρ(z−z′)⩽ρ(z)+ρ(z′)⩽2(k−1). |
Therefore, z−z′∈U. Since the previous expression for x is also unique (modU) when x∈W, we conclude that the following function is well defined:
f:V→V/U |
f(x)=z+U, if x=y+z,y∈W,ρ(z)<k. |
Let us now show that f is a linear map. Consider x=y+z as a previous representation of x. For any c∈F, we have cx=cy+cz, which gives the corresponding representation of cx. Hence, f(cx)=cz+U=c(z+U).
Next, suppose x=y+z, x′=y′+z′, and x+x′=y″ for appropriate y, z, y', z', y'', z'' . We then have:
f(x)+f(x') = z+z'+U;\quad f(x+x') = z''+U. |
We have z''-z-z' = y+y'-y''\in U and \rho(z''-z-z')\leqslant 3(k-1) . Therefore, z''-z-z'\in U and we conclude that f(x+x') = f(x)+f(x') . The kernel of f consists of those x where the corresponding z belongs to U . However, if x = y+z where y\in W and z\in U , then z\in W . Therefore, \mathrm{Ker}\, (f) = W .
To show that f is onto, note that every vector in V is a sum of vectors where the rank function takes the value 1. It suffices to show that for any z with \rho(z) = 1 , there exists an x such that f(x) = z + U . But,
f(z) = f(0+z) = z+U. |
Thus, f is onto, completing the proof.
Theorem 2. Let k\geqslant 2 be an integer, and let q be the largest integer for which a finite-dimensional vector space V with rank function \rho admits a vector subspace W^{\prime} of dimension q such that \rho(W^{\prime}) = k . Then, there exists such a subspace W which admits a basis entirely composed of elements w_i such that \rho(w_i) = k for all i .
Proof. Among those subspaces W of maximum dimension q , which contain no non-zero elements of rank less than k , let us choose one such that \rho(e) is minimal, where e is a sorted unshrinkable basis of W . It suffices to prove \rho(e) = kq .
To prove \rho(e) = kq , assume otherwise, \rho(e) > kq . Let e = [v_1, \ldots, v_q] . Since \rho(e) > kq , it follows that \rho(v_q) = l > k . We know there exist w and w^{\prime} such that v_q = w+w^{\prime} , \rho(w) = k , and \rho(w^{\prime}) = l-k .
We prove that e^{\prime} = \{v_1, \ldots, v_{q-1}, w\} is linearly independent, and the subspace W^{\prime} spanned by e^{\prime} satisfies \rho(W^{\prime}) = k .
Suppose for some linear combination z of elements in e^{\prime} :
\begin{equation*} z = \sum\limits_{i = 1}^{q-1}\alpha_iv_i+\beta w,\quad \rho(z)\leqslant k-1. \end{equation*} |
This will establish the properties we want to prove. If \beta = 0 , then z = 0 since \rho(W) = k . Consequently, all \alpha_i 's are zero. Thus, \beta\neq 0 , and we define an element t by:
\begin{equation*} t = \sum\limits_{i = 1}^{q-1}\alpha_iv_i+\beta v_q. \end{equation*} |
Since \beta\neq 0 , by Lemma 1, \rho(t)\geqslant l = \rho(v_q) . On the other hand:
\begin{equation*} t = z+\beta(v_q-w). \end{equation*} |
Then,
\begin{equation*} \rho(t)\leqslant\rho(z)+\rho(v_q-w) \leqslant k-1+l-k = l-1. \end{equation*} |
Let W^{\prime} be the subspace spanned by e^{\prime} . Then \dim W^{\prime} = \dim W , and \rho(e^{\prime}) < \rho(e) . Therefore W' is a subspace of maximum dimension containing no non-zero elements of rank less than k , and it has an unshrinkable basis e' such that \rho(e') < \rho(e) . Since we may transform this basis into a sorted one, this contradicts our choice of W .
Thus, we have a contradiction, which completes the proof.
For a finite-dimensional vector space V , define
L(V,\rho,k) : = \max\{\dim W : W \text{ is a subspace of } V \text{ such that } (\forall v \in W \setminus \{0\}) \; \rho(v) \geq k \}. |
We immediately obtain the following corollary of Theorem 2.
Corollary 1. For a given finite-dimensional vector space V over a field \mathbb F , rank function \rho , and integer k\geqslant 2 , we have that L(V, \rho, k) is the maximal number s such that there exists x_1, \dots, x_s\in V , with \rho(x_1) = \dots = \rho(x_s) = k , for which \rho(\alpha_1x_1+\cdots+\alpha_sx_s)\geqslant k for every non-trivial linear combination ( \alpha_i\in\mathbb F\setminus\{0\} for at least one index i ).
Therefore, if one wants to find L(V, \rho, k) it is enough to consider elements of rank k whose non-trivial linear combinations are of rank at least k .
In this section, we present additional examples of rank functions in vector spaces. It is easy to check that they all satisfy the conditions in Definition 2.
Example 5. Symmetric tensor and symmetric tensor rank.
Let \mathbb F be a field and V a finite-dimensional vector space over \mathbb F . An element \mathcal{A}\in \overbrace{V\otimes V\otimes\cdots\otimes V}^n is symmetric if \sigma(\mathcal{A}) = \mathcal{A} for all \sigma\in\mathbb S_n , where \sigma acts on \mathcal{A} in the usual way. The symmetric tensor rank of \mathcal{A} is defined as the minimal r such that
\mathcal{A} = \sum\limits_{i = 1}^rv_i\otimes v_i\otimes \cdots\otimes v_i, |
for some v_i\in V\setminus\{0\} . For more details on this rank, we refer the reader to the paper by Comon [7].
Example 6. Slice and partition rank.
The notion of slice rank was introduced by Tao in his blog [42] and partition rank was introduced by Naslund in [32]. They are of crucial importance in additive combinatorics.
Definition 4. Let X_1, \dots, X_n be finite sets and \mathbb F a field. We say that a function h\colon X_1\times\cdots\times X_n\to \mathbb F has slice rank 1, denoted by \mathrm{srank} , if
h(x_1,\dots,x_n) = f(x_i)g(x_1,\dots,x_{i-1},x_{i+1},\dots x_n), |
for some i\in\{1, \dots, n\} and functions f and g . Then the slice rank is defined as
\mathrm{srank}(h): = \min\{r:h = h_1+\cdots+h_r,\; \mathrm{srank}(h_i) = 1\}. |
Definition 5. Let X_1, \dots, X_n be finite sets and \mathbb{F} a field. We say that a function h: X_1 \times \cdots \times X_n \to \mathbb{F} has partition rank 1, denoted by \mathrm{prank} , if
h(x_1, \dots, x_n) = f_1(x_{s_{11}}, \dots, x_{s_{1i_1}}) \cdots f_k(x_{s_{k1}}, \dots, x_{s_{ki_k}}), |
for some k and functions f_i: S_i \to \mathbb{F} , where \{1, \dots, n\} = S_1 \sqcup \dots \sqcup S_k and S_r = \{s_{r1}, \dots, s_{ri_r}\} . Then the partition rank is defined as
\mathrm{prank}(h) : = \min\{r : h = h_1 + \cdots + h_r, \; \mathrm{prank}(h_i) = 1\}. |
If we denote the usual tensor rank by \mathrm{trank} , then we have the inequalities
\mathrm{prank}(h) \leqslant \mathrm{srank}(h) \leqslant \mathrm{trank}(h) |
for every h .
Example 7. Waring rank.
Let k be an algebraically closed field of characteristic zero, and consider k[X_1, \dots, X_n] , the graded polynomial ring in n indeterminates over k . Let F be a non-zero homogeneous d -form. The Waring rank of this form is defined as the smallest r such that
F = \sum\limits_{i = 1}^r L_i^d, |
where L_i are linear forms. This rank satisfies our conditions, with forms of rank 1 being powers of linear forms. Condition (2) is satisfied since the field k is algebraically closed.
The Waring rank is related to the classical Waring problem in number theory and also to Hilbert's 17th problem. For more about this, we refer the reader to [5,12,21].
Example 8. Schmidt rank.
This concept arises in quantum mechanics and is significant in quantum information theory. Simply put, for two finite-dimensional Hilbert spaces \mathcal{H}_1 and \mathcal{H}_2 over \mathbb{C} , any vector w \in \mathcal{H}_1 \otimes \mathcal{H}_2 can be expressed as
w = \lambda_1 u_1 \otimes v_1 + \cdots + \lambda_r u_r \otimes v_r, |
where u_1, \dots, u_r \in \mathcal{H}_1 and v_1, \dots, v_r \in \mathcal{H}_2 are orthonormal vectors, and \lambda_i are non-zero complex numbers. The Schmidt rank of w is defined to be the number r , denoted \mathrm{Sch}(w) = r .
In [9], the authors discuss the problem of finding L(\mathbb C^d\otimes C^d, \mathrm{Sch}, k) . See also [43], where the notion of a Schmidt number for density matrices, related to Schmidt rank, is introduced.
Example 9. Stabilizer rank.
This concept is another important notion from quantum information theory. For a quantum state \psi , the stabilizer rank is the minimal r such that, in Dirac ket notation:
|\psi\rangle = \sum\limits_{j = 1}^r c_j\,|\,\varphi_j\rangle, |
where c_j \in \mathbb{C} and |\, \varphi_j\rangle are stabilizer states. For more details on stabilizer rank, refer to [29,30,34].
Condition (4) in Definition 2 is rather restrictive. Let us discuss briefly the border rank of a tensor, denoted here by \mathrm{brank}(\mathbf{t}) . Simply put, the border rank of a tensor \mathbf{t} is defined as the smallest r such that \mathbf{t} lies in the closure of the subset of tensors of rank r in the appropriate projective space (for more details and precise definitions, see, e.g., [2] and [11]).
Since tensors of rank 1 form a closed subset, we have that for any tensor \mathbf{t} , \mathrm{trank}(\mathbf{t}) = 1 if and only if \mathrm{brank}(\mathbf{t}) = 1 . Therefore, if \mathrm{brank} were to satisfy condition (4), then from Proposition 1, it would follow that \mathrm{brank}(\mathbf{t}) = \mathrm{trank}(\mathbf{t}) for all tensors \mathbf{t} . However, since this is not the case, we conclude that \mathrm{brank} is not a rank function in our sense.
As pointed out in Section 2, the usual rank properties of matrices do not carry over to higher-order tensors. However, Theorems 1 and 2 reveal that certain aspects of rank properties may be extended to tensors.
In establishing the main results of this paper, the introduction of the rank function \rho was essential. This function was purposefully chosen to capture the fundamental properties of the tensor rank. However, as demonstrated by several examples presented, there exist interesting rank functions that satisfy our conditions. By customizing rank functions for specific problem domains, valuable insights can potentially be obtained.
Finally, it should be noted that our rank function is distinct from various rank functions arising in connection with Strassen's work on asymptotic spectra (for a comprehensive presentation of these results, from the modern viewpoint which include (Strassen) preorder on semirings, see [44]). Our rank function is simpler – it takes values in the set of non-negative integers, can be defined on all vector spaces, and does not require any deeper structural assumptions.
Petrović: Conceptualization, Investigation, Methodology, Validation, Writing – review & editing; Pucanović: Conceptualization, Investigation, Funding acqusition, Project administration, Supervision, Writing – original draft; Pešović: Conceptualization, Validation; Kovačević: Conceptualization. Project administration.
All authors have read and approved the final version of the manuscript for publication.
The authors declare they have not used Artificial Intelligence (AI) tools in the creation of this article.
The authors would like to thank Mr. Vojislav Milutinović from the company Two Desperados, whose idea was to form our small research team. Research for this paper was supported by the Linear Algebra and Artificial Intelligence project funded by Algebra AI, Belgrade, Serbia.
Finally, we express our gratitude to the anonymous referees for their careful reading of our manuscript and their valuable suggestions, which significantly improved this paper.
All authors declare no conflicts of interest in this paper.
[1] |
J. F. Adams, Vector fields on spheres, Ann. Math., 75 (1962), 603–632. https://doi.org/10.2307/1970213 doi: 10.2307/1970213
![]() |
[2] |
E. Ballico, A. Bernardi, Tensor ranks on tangent developable of Segree varieties, Linear Multil. Algebra, 61 (2013), 881–894. https://doi.org/10.1080/03081087.2012.716430 doi: 10.1080/03081087.2012.716430
![]() |
[3] |
G. M. Bergman, Ranks of tensors and change of base field, J. Algebra, 11 (1969), 613–621. https://doi.org/10.1016/0021-8693(69)90094-5 doi: 10.1016/0021-8693(69)90094-5
![]() |
[4] |
W. Bruzda, S. Friedland, K. Życzkowski, Rank of a tensor and quantum entanglement, Linear Multil. Algebra, 72 (2023), 1796–1859. https://doi.org/10.1080/03081087.2023.2211717 doi: 10.1080/03081087.2023.2211717
![]() |
[5] |
E. Carlini, M. V. Catalisano, A. V. Geramita, The solution to the Waring problem for monomials and the sum of coprime monomials, J. Algebra, 370 (2012), 5–14. https://doi.org/10.1016/j.jalgebra.2012.07.028 doi: 10.1016/j.jalgebra.2012.07.028
![]() |
[6] |
J. D. Carroll, J. J. Chang, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika, 35 (1970), 283–319. https://doi.org/10.1007/BF02310791 doi: 10.1007/BF02310791
![]() |
[7] |
P. Comon, G. Golub, L. H. Lim, B. Mourrain, Symmetric tensors and symmetric tensor rank, SIAM J. Matrix Anal. Appl., 30 (2008), 1254–1279. https://doi.org/10.1137/060661569 doi: 10.1137/060661569
![]() |
[8] |
P. Comon, J. M. F. ten Berge, L. De Lathauwer, J. Castaing, Generic and typical ranks of multi-way arrays, Linear Algebra Appl., 430 (2009), 2997–3007. https://doi.org/10.1016/j.laa.2009.01.014 doi: 10.1016/j.laa.2009.01.014
![]() |
[9] |
T. Cubitt, A. Montanaro, A. Winter, On the dimension of subspaces with bounded Schmidt rank, J. Math. Phys., 49 (2008), 022107. https://doi.org/10.1063/1.2862998 doi: 10.1063/1.2862998
![]() |
[10] |
H. Derksen, Kruskal's uniqueness inequality is sharp, Linear Algebra Appl., 438 (2013), 708–712. http://dx.doi.org/10.1016/j.laa.2011.05.041 doi: 10.1016/j.laa.2011.05.041
![]() |
[11] |
V. De Silva, L. H. Lim, Tensor rank and the ill-posedness of the best low-rank approximation problem, SIAM J. Matrix Anal. Appl., 30 (2008), 1084–1127. https://doi.org/10.1137/06066518X doi: 10.1137/06066518X
![]() |
[12] |
W. J. Ellison, A 'Waring problem' for homogeneous forms, Math. Proc. Camp. Phil. Soc., 65 (1969), 663–672. https://doi.org/10.1017/S0305004100003455 doi: 10.1017/S0305004100003455
![]() |
[13] |
D. Falikman, S. Friedland, R. Loewy, On spaces of matrices containing a nonzero matrix of bounded rank, Pacific J. Math., 207 (2002), 157–176. https://doi.org/10.2140/pjm.2002.207.157 doi: 10.2140/pjm.2002.207.157
![]() |
[14] |
P. Gubkin, On unique tensor rank decomposition of 3-tensors, Linear Multil. Algebra, 72 (2023), 1860–1866. https://doi.org/10.1080/03081087.2023.2211718 doi: 10.1080/03081087.2023.2211718
![]() |
[15] |
D. Handel, On subspaces of tensor products containing no elements of rank one, J. Algebra, 14 (1970), 523–527. https://doi.org/10.1016/0021-8693(70)90099-2 doi: 10.1016/0021-8693(70)90099-2
![]() |
[16] | R. A. Harshman, Foundations of the PARAFAC procedure: models and conditions for an "explanatory" multi-modal factor analysis, UCLA Working Papers in Phonetics, 16 (1970), 1–84. |
[17] | J. Håstad, Tensor rank is NP-complete, In: Automata, Languages and Programming. ICALP 1989. Lecture Notes in Computer Science, 372 (1989), 451–460. https://doi.org/10.1007/BFb0035776 |
[18] |
F. L. Hitchcock, The expression of a tensor or a polyadic as a sum of products, J. Math. Phys., 6 (1927), 164–189. https://doi.org/10.1002/sapm192761164 doi: 10.1002/sapm192761164
![]() |
[19] |
F. L. Hitchcock, Multilple invariants and generalized rank of a p-way matrix or tensor, J. Math. Phys., 7 (1927), 39–79. https://doi.org/10.1002/sapm19287139 doi: 10.1002/sapm19287139
![]() |
[20] |
A. Hurwitz, Über der Komposition der quadratischer Formen, Math. Ann., 88 (1922), 1–25. https://doi.org/10.1007/BF01448439 doi: 10.1007/BF01448439
![]() |
[21] | A. Iarrobino, V. Kanev, Power sums, gorenstein algebras, and determinantal Loci, In: Lecture Notes in Mathematics 1721, Berlin: Springer, 1999. |
[22] | N. Johnston, B. Lovitz, A. Vijayaraghavan, Computing linear sections of varieties: quantum entanglement, tensor decompositions and beyond, In: 2023 IEEE 64th Annual Symposium on Foundations of Computer Science (FOCS), 2023, 1316–1336. https://doi.org/10.1109/FOCS57990.2023.00079 |
[23] |
T. G. Kolda, B. W. Bader, Tensor decompositions and applications, SIAM Rev., 51 (2009), 455–500. https://doi.org/10.1137/07070111X doi: 10.1137/07070111X
![]() |
[24] |
J. B. Kruskal, Three-way arrays: rank and uniqueness of trilinear decompositions, with application to arithmetic complexity and statistics, Linear Algebra Appl., 18 (1977), 95–138. https://doi.org/10.1016/0024-3795(77)90069-6 doi: 10.1016/0024-3795(77)90069-6
![]() |
[25] | J. B. Kruskal, Statement of Some Current Results about Three-Way Arrays, manuscript, AT & T Bell Laboratories, 1983. Available from: http://three-mode.leidenuniv.nl/pdf/k/kruskal1983.pdf. |
[26] |
K. Y. Lam, P. Yiu, Linear spaces of real matrices of constant rank, Linear Algebra Appl., 195 (1993), 69–79. https://doi.org/10.1016/0024-3795(93)90257-O doi: 10.1016/0024-3795(93)90257-O
![]() |
[27] |
R. Loewy, N. Radwan, Spaces of symmetric matrices of bounded rank, Linear Algebra Appl., 197/198 (1994), 189–215. https://doi.org/10.1016/0024-3795(94)90488-X doi: 10.1016/0024-3795(94)90488-X
![]() |
[28] |
B. Lovitz, F. Petrov, A generalization of Kruskal's theorem on tensor decomposition, Forum Math., Sigma, 11 (2023), e27. https://doi.org/10.1017/fms.2023.20 doi: 10.1017/fms.2023.20
![]() |
[29] |
B. Lovitz, N. Johnston, Entangled subspaces and generic local state discrimination with pre-shared entanglement, Quantum, 6 (2022), 760. https://doi.org/10.22331/q-2022-07-07-760 doi: 10.22331/q-2022-07-07-760
![]() |
[30] |
B. Lovitz, V. Steffan, New techniques for bounding stabilizer rank, Quantum, 6 (2022), 692. https://doi.org/10.22331/q-2022-04-20-692 doi: 10.22331/q-2022-04-20-692
![]() |
[31] |
R. Meshulam, On k-spaces of real matrices, Linear Multil. Algebra, 26 (1990), 39–41. https://doi.org/10.1080/03081089008817963 doi: 10.1080/03081089008817963
![]() |
[32] |
E. Naslund, The partition rank of a tensor and k-right corners in \mathbb{F}_q^n, J. Combin. Theory Ser. A, 174 (2020), 105190. https://doi.org/10.1016/j.jcta.2019.105190 doi: 10.1016/j.jcta.2019.105190
![]() |
[33] |
G. Ni, Y. Li, A semidefinite relaxation method for partially symmetric tensor decomposition, Math. Oper. Res., 47 (2022), 2931–2949. https://doi.org/10.1287/moor.2021.1231 doi: 10.1287/moor.2021.1231
![]() |
[34] |
S. Peleg, A. Shpilka, B. L. Volk, Lower bounds on stabilizer rank, Quantum, 6 (2022), 652. https://doi.org/10.22331/q-2022-02-15-652 doi: 10.22331/q-2022-02-15-652
![]() |
[35] | Z. Z. Petrović, On spaces of matrices satisfying some rank conditions, Ph.D thesis, The Johns Hopkins University, USA, 1996. |
[36] |
Z. Z. Petrović, Bases of spaces of matrices satisfying rank conditions, Linear Multil. Algebra, 57 (2009), 625–631. https://doi.org/10.1080/03081080802316198 doi: 10.1080/03081080802316198
![]() |
[37] |
J. Radon, Lineare Scharen orthogonalen Matrizen, Abh. Math. Sem. Univ. Hamburg, 1 (1922), 1–14. https://doi.org/10.1007/BF02940576 doi: 10.1007/BF02940576
![]() |
[38] |
E. G. Rees, Linear spaces of real matrices of large rank, Proc. Roy. Soc. Edinburgh Sect. A, 126 (1996), 147–151. https://doi.org/10.1017/S030821050003064X doi: 10.1017/S030821050003064X
![]() |
[39] |
J. Rhodes, A concise proof of Kruskal's theorem on tensor decomposition, Linear Algebra Appl., 432 (2010), 1818–1824. https://doi.org/10.1016/j.laa.2009.11.033 doi: 10.1016/j.laa.2009.11.033
![]() |
[40] |
C. Seguins Pazzis, Large affine spaces of matrices with rank bounded below, Linear Algebra Appl., 437 (2012), 499–518. https://doi.org/10.1016/j.laa.2012.03.008 doi: 10.1016/j.laa.2012.03.008
![]() |
[41] |
N. D. Sidiropoulos, R. Bro, On the uniqueness of multilinear decomposition of N-way arrays, J. Chemometr., 14 (2000), 229–239. https://doi.org/10.1002/1099-128X(200005/06)14:3<229::AID-CEM587>3.0.CO;2-N doi: 10.1002/1099-128X(200005/06)14:3<229::AID-CEM587>3.0.CO;2-N
![]() |
[42] | T. Tao, A symmetric formulation of the croot-lev-pach-ellenberg-gijswijt capset bound, Tao's Blog Post, 2016. |
[43] |
B. M. Terhal, P. Horodecki, Schmidt number for density matrices, Phys. Rev. A, 61 (2000), 040301. https://doi.org/10.1103/PhysRevA.61.040301 doi: 10.1103/PhysRevA.61.040301
![]() |
[44] | A. Wigderson, J. Zuiddam, Asymptotic spectra: theory, applications and extensions, Manuscript, 2022. |