Open-access THE TIGHTNESS OF STRENGTHENED SEMIDEFINITE RELAXATIONS FOR THE BOOLEAN QUADRATIC PROGRAMMING PROBLEM WITH GENERALIZED UPPER BOUND CONSTRAINTS

ABSTRACT

This paper studies semidefinite programming (SDP) relaxations for the Boolean Quadratic Programming problem with Generalized Upper Bound constraints (BQP-GUB), which arises in several application domains. We show that conventional semidefinite relaxation (SDR) does not yield tight bounds for this problem. We then analyze strengthened SDP relaxations and identify formulations that produce tight or near-tight bounds, particularly those based on reduced reformulation-linearization techniques (SDR+RRLT and SSDR+RRLT. Numerical experiments demonstrate that these approaches significantly reduce the relaxation gap compared to SDR, while highlighting the trade-off between bound quality and computational scalability.

Keywords:
BQP-GUB; SDP; semidefinite relaxation; vector lifting; matrix lifting; combinatorial optimization; enhanced semidefinite relaxation

1 INTRODUCTION

Consider S = {1, 2, . . . , n}, a finite set representing the first n natural numbers. Let p i denote the cost associated with each iS, and r ij denote the cost associated with each pair (i, j) ∈ S ×S. The linear vector p = (p 1 , p 2 , · · · , p n ) represents the cost vector, while the matrix R = [r i j ] ∈ ℝn×n represents the quadratic cost matrix. Without loss of generality, we assume that R is symmetric, since any asymmetric matrix can be replaced by 12(R+R) without affecting the objective value or the optimal solution set.

Let C 1 ,C 2 , . . . ,C m be mutually disjoint subsets of S such that S=k=1mCk. The Boolean Quadratic Programming problem with Generalized Upper Bound constraints (BQP-GUB) (Wang & Punnen, 2017) is given by:

max f ( x ) = i = 1 n p i x i + i = 1 n j = 1 n r i j x i x j s.t. j C k x j = 1 , k = 1 , 2 , , m , x j { 0 , 1 } , j = 1 , 2 , , n . (1)

The above formulation represents a combinatorial optimization problem. The BQP-GUB problem generalizes the classical quadratic semi-assignment problem (QSAP).

QSAP has a wide range of applications, including co-clustering of image segments (Vitaladevuni & Basri, 2010), correlation clustering (Demaine et al., 2006), scheduling (Chrétienne, 1989), asset allocation (Gelenbe et al., 2010), and metric labeling (Kleinberg & Tardos, 2002). Consequently, BQP-GUB inherits significant practical relevance. The QSAP was first introduced by Greenberg (Greenberg, 1969), and has since been studied extensively in various contexts.

From a computational perspective, QSAP is a relaxation of the quadratic assignment problem (QAP), obtained by replacing assignment constraints with semi-assignment constraints. Since QAP is NP-hard, QSAP and BQP-GUB are also NP-hard (Chhajed & Lowe, 1992). Moreover, even moderate problem sizes are challenging; for example, QAP instances with dimension greater than 25 are already considered large-scale (Ding & Wolkowicz, 2009). Semidefinite programming (SDP) relaxations have been successfully applied to QAP, starting with the work of Zhao et al. (1998).

To address the computational difficulty of BQP-GUB, relaxation techniques are essential. While spectral methods are computationally attractive, they often produce weak bounds (Guattery & Miller, 1998; Kannan et al., 2004; Lang, 2005). In contrast, semidefinite relaxation (SDR) methods typically provide tighter bounds and have proven effective in various applications, including image segmentation (Heiler et al., 2005), co-segmentation (Joulin et al., 2010), and subgraph matching (Schellewald & Schnörr, 2005). However, a systematic and detailed study of SDP relaxations for BQP-GUB is still lacking.

Although SDR, redundant quadratic constraints, and reformulation-linearization techniques are well established, their structured application and comparative analysis for BQP-GUB remain largely unexplored. In this work, we address this gap by developing and analyzing several SDP-based relaxations tailored to the structure of BQP-GUB.

A key contribution of this paper is a unified theoretical and computational investigation showing that several seemingly different formulations are, in fact, equivalent in terms of bound quality. In particular, we demonstrate that improvements in relaxation strength primarily arise from the incorporation of stronger valid constraints, especially reduced reformulation linearization techniques (RRLT), rather than from alternative lifting strategies. This allows us to distinguish clearly between redundant formulations and those that provide meaningful improvements.

In addition, we propose an alternative enhanced semidefinite relaxation (AESDR) and evaluate its performance alongside existing methods. Extensive computational experiments on standard BQP-GUB instances highlight the trade-off between relaxation tightness and computational scalability: RRLT based formulations yield tighter bounds but are less scalable, whereas simpler relaxations remain computationally efficient for larger instances.

The main contributions of this work are summarized as follows:

  • We provide a systematic study of SDP relaxations for the BQP-GUB problem, emphasizing structural properties that influence their performance;

  • We establish theoretical equivalences among several formulations, showing that SDR, VSDR, and MSDR yield identical bounds, as do SSDR and ESDR, thereby reducing redundancy;

  • We demonstrate that the primary improvement in relaxation quality is driven by RRLT constraints rather than alternative SDP formulations;

  • We propose an alternative enhanced SDP relaxation (AESDR) and compare it with existing approaches;

  • We present extensive numerical experiments (up to dimension 500) illustrating the trade-off between bound quality and computational scalability.

In the first Section, we introduce the problem, and in subsequent sections, we propose different semidefinite relaxations to this problem. In Section 10, we apply these methods to BQP-GUB datasets which we generated ourselves.

1.1 Notation

The following notations are used in this research.

  1. X ⪰ 0: Symmetric matrix X is positive semidefinite and XY to denote XY is positive semidefinite.

  2. XY: For n × n matrices X and Y , XY = tr(X Y).

  3. diag(X ): The vector x with x i = X ii , i = 1, ..., n, where the matrix X is of size n × n.

  4. trace(·): trace of a matrix

2 SEMIDEFINITE RELAXATION OF BQP-GUB (SDR)

BQP-GUB is known to be NP-hard. This means that no efficient exact algorithm is available. Since BQP-GUB is non-convex, it is difficult to solve using standard optimization methods.

A common approach to handle such problems is semidefinite relaxation (SDR). This method converts the non-convex problem into a convex one by relaxing certain constraints. However, SDR is often limited in practice because it requires high computational effort and usually gives weak bounds.

In this paper, we do not focus on reducing complexity. Instead, our goal is to develop a semidefinite relaxation that gives tighter bounds for BQP-GUB. In order to obtain the semidefinite relaxation and for ease of presentation, the objective function in 1 can be written in compact matrix-vector form as:

max f ( x ) = p x + x R x s.t. j C k x j = 1 for k = 1 , 2 , , m , x j { 0 , 1 } for j = 1 , 2 , , n . (2)

where p = (p 1 , p 2 , ..., p n ) and R = [r i j ]n×n . Since x j ∈ {0, 1} for j = 1, 2, . . . , n, the linear term of the objective function can be replaced by a quadratic term, resulting in the following transformed problem formulation:

max f ( x ) = x Q x s.t. j C k x j = 1 for k = 1 , 2 , , m , x j { 0 , 1 } for j = 1 , 2 , , n . (3)

where Q = [q i j ] ∀i, j ∈ 1, 2, ..., n such that

p i + r i j if i = j , r i j otherwise .

The optimal solution of the problem (3) is equal to the negative of the optimal solution of the following minimization problem:

m i n f x = x Q ¯ x s.t. j C k x j = 1 for k = 1 , 2 , , m , x j { 0 , 1 } for j = 1 , 2 , , n . (4)

where Q¯=-Q. Here, we consider the equivalent minimization form and for consistency, all subsequent SDP formulations are written using Q¯.

In this paper, we propose some different SDP formulations of BQP-GUB 3. We begin with the first formulation as follows.

Since xQ¯x=tr(Q¯xx), we introduce a matrix variable X = xx . The condition X = xx is equivalent to requiring X ⪰ 0 and rank(X ) = 1. In semidefinite relaxation, the rank condition is dropped, yielding a convex feasible set.

For Boolean variables x j ∈ {0, 1}, we have the identity xj2=xj. Hence, the generalized upper bound constraints

j C k x j = 1 , k = 1 , 2 , , m ,

can equivalently be written as

j C k x j 2 = 1 , k = 1 , 2 , , m ,

Let us define a matrix (D k )n×n = [(d k )ij ]n×n such that

( d k ) i j = 1 for i = j C k for k = 1 , 2 , , m , 0 otherwise

Therefore, the quadratic form of it is expressed as

x D k x = 1 , k = 1 , 2 , , m .

Finally, in terms of X, the constraints x D k x = 1 can be represented as

D k X = 1 , k = 1 , 2 , , m ,

and the relation diag(X) = x is imposed to link X and x.

By lifting the vector variable x to the matrix variable X and applying the Schur complement (Boyd & Vandenberghe, 2004), the nonconvex constraint X = xx can be equivalently reformulated as

1 x x X 0 , rank ( X ) = 1 .

The rank constraint is inherently nonconvex, which makes the problem computationally challenging. A common relaxation strategy is to omit the rank condition, thereby obtaining a convex semidefinite program (SDP). Alternative formulations introduce convex surrogates for the rank, such as Frobenius norm or nuclear norm penalties (see Nayak & Mohanty (2019)). In this work, we adopt the standard relaxation by simply dropping the rank constraint. The resulting semidefinite relaxation of the BQP-GUB (4) is

min Q ¯ X s.t. D k X = 1 , k = 1 , 2 , , m , diag ( X ) = x , 1 x x X 0 . (6)

Next, under additional assumptions, we obtain a relationship between optimal values between the problems (4) and (6).

Note that throughout the paper p1* denotes the optimal value of the problem (4).

Theorem 1. If the problem (4) is feasible then the problem (6) is also feasible. If p 2 * is the optimal value of the problem (6) then p 1 * p 2 * .

Proof. For feasible x to (4), set X = xx . Then D kX = x D k x = 1, diag(X ) = x, and 1xxX0 with objective QX=xQxp2*, yielding p1*p2*. □

The semidefinite relaxation (SDR) provides a convex approximation of the BQP-GUB problem, but it often produces loose bounds due to the relaxation of the rank and Boolean constraints. To improve the quality of the solution, it is useful to incorporate additional constraints that strengthen the SDP formulation. In the following section, we introduce a strengthened semidefinite relaxation (SSDR) that incorporates such constraints to achieve better approximate the original problem.

3 STRENGTHENED SEMIDEFINITE RELAXATION (SSDR) FOR BQP-GUB

To proceed with the second formulation, we define an m × n matrix A = [a ij ] representing the generalized upper bound constraints, where

a i j = 1 if j C k and i = k , 0 otherwise .

Let e ∈ ℝm denote the all-ones vector. Using this notation, the equality constraints of problem ((4)) can be written compactly as

min f ( x ) = x Q ¯ x s.t. A x = e , x j { 0 , 1 } , j = 1 , 2 , , n . (7)

which shows the equivalence of the problems (4) and (7).

A standard technique for improving relaxations is the addition of redundant constraints. Such constraints do not change the feasible set but can reduce the duality gap and yield tighter bounds. As shown in Anstreicher et al. (1999) and Anstreicher & Wolkowicz (2000), they may also help guarantee strong duality in situations where it would otherwise fail.

To strengthen (7), we include the squared-norm constraint

A x - e 2 = 0 ,

which expands to (Axe)(Axe) = x A Ax − 2e Ax + e e. Since Ax = e is already enforced, this reduces to

x A A x = e e .

The resulting problem is a quadratically constrained quadratic program (QCQP):

min x Q ¯ x s.t. A x = e , x A A x = e e , x j { 0 , 1 } , j = 1 , 2 , , n . (8)

The semidefinite relaxation (SDR) of this strengthened formulation is

min Q ¯ X s.t. A x = e , diag ( X ) = x , A A X = e e , 1 x x X 0 . (9)

To improve the solution quality, stronger relaxations are needed. One effective approach is to incorporate reformulation-linearization techniques (RLT), which introduce additional inequalities and quadratic constraints. These strengthened relaxations tighten the feasible region and enhance the bounds. In the next section, we introduce RLT-based semidefinite relaxations and discuss their formulation and properties.

4 REFORMULATION LINEARIZATION TECHNIQUES BASED RELAXATIONS OF BQP-GUB

This section introduces semidefinite relaxations of BQP-GUB using the reformulation linearization techniques (RLT). For ease of presentation, we first define the relaxation gap and tightness of a semidefinite relaxation as follows.

Definition 1. The difference between the optimal solution of the original problem and the solution obtained using semidefinite relaxation is called the relaxation gap.

Definition 2.A tight relaxation in the context of semidefinite programming (SDP) refers to a specific type of relaxation where the optimal value of the relaxed problem (SDP) coincides with the optimal value of the original problem. This essentially means that the relaxed problem provides the exact solution to the original problem. In semidefinite programming (SDP), achieving a tight relaxation where the solution matches the original problem is often difficult and not guaranteed for all problems. Researchers and practitioners investigate conditions and methods to enhance the likelihood of achieving tight relaxation in specific problem classes. The proposed method outperforms the semidefinite relaxation method discussed in Section 2.

The problem (4) can be further strengthened by introducing additional quadratic constraints, as observed in prior literature (Anstreicher, 2009; Faye & Roupin, 2007). Here, we specifically investigate the incorporation of squared norm constraints and simple RLT inequalities (Sherali & Adams, 2013) in particular.

4.1 SSDR relaxation with RLT (SSDR+RLT)

If we add the RLT inequalities (Sherali & Adams, 2013)

X i j 0 , X i j x i + x j - 1 i < j ,

and

X i j x i i j ,

to problem (8), then it can be reformulated as

min x Q ¯ x s.t. A x = e x A A x = e e x i x j 0 , x i x j x i + x j - 1 i < j x i x j x i i j x j { 0 , 1 } , j = 1 , 2 , , n . (10)

Note that the inequality x i x jx j is redundant, since it is obtained by interchanging the indices in x i x jx i when the constraint is imposed for all ordered pairs i ≠ j.

The semidefinite relaxation of problem (10) is given by

min Q ¯ X s.t. A x = e diag ( X ) = x A A X = e e X i j 0 , X i j x i + x j - 1 i < j X i j x i i j 1 x x X 0 . (11)

Now to understand the effectiveness of SSDR+RLT in (11), we start comparing the optimal values of (7) and (11). As the problems (4) and (7) are same, therefore, p1* is also optimal value of the problem (7). Then, assuming further conditions, we demonstrate the relation between the optimal values and solutions for (7) and (11).

Theorem 2. If the problem (7) is feasible then the problem (11) is also feasible. If p 3 * is the optimal value of the problem (11) then p 1 * p 3 * .

Proof. Let x ∈ ℝn solve (7) feasibly and set X = xx . Then Ax = e holds, A Ax = e e follows from ∥Axe2 = 0, diag(X) = x relaxes the Boolean constraints, and RLT inequalities hold identically (Sherali & Adams, 2013). Thus (x, X) solves (11) feasibly with Q¯X=xQ¯xp3*, so p1*p3*. □

Theorem 3.Suppose (x , X ) is an optimal solution of the problem (11) and let x ∈ {0, 1}n . Assume that both x and X satisfying the inequality

Q ¯ X * x * Q ¯ x * . (12)

Then xis an optimal solution to (7) andp1*=p3*. AlsoQ¯X*=x*Q¯x*.

Proof. If (x , X ) is an optimal solution to the problem (11) and x ∈ {0, 1}n then clearly x is feasible to the original problem (7). Now, considering the given inequality (12) and Theorem (2), we conclude that p3*=Q¯X*x*Q¯x*p1*p3*. Hence, p1*=p3* implies Q¯X*=x*Q¯x*. □

In the next proposition, we present a sufficient condition to ensure inequality (12). This condition is closely connected to the Finsler characterization of positive semidefiniteness for a matrix P 0 over the null subspace {x ∈ ℝn |Ax = 0} (Finsler, 1937).

Proposition 1.The inequalityQ¯XxQ¯xholds for any (x, X) feasible to (11) if there exists δ ∈ ℝ such thatQ¯+δAA0.

Proof. Let us assume that Q¯+δAA0 for some δ. It follows from fundamental properties of positive semidefinite matrices that tr(MN) ≥ 0 for any M ⪰ 0, N ⪰ 0, M, N ∈ 𝕊n . Let M = Xxx ⪰ 0. Consequently, 0tr((Q¯+δAA)(X-xx))=tr(Q¯X-Q¯xx)+δ[tr(AAX)-tr(AAxx)] =tr(Q¯X-Q¯xx)+δ[tr(A(AX-Axx)]=tr(Q¯X-Q¯xx)=tr(Q¯X)-xQ¯x, because AX = Axx for any (x, X) feasible to (11). Hence, Q¯XxQ¯x.□

Albeit, SDR (11) is a semidefinite relaxation of BQP-GUB, it is not able to solve problems of dimension greater than 50. So, we propose a reduced RLT in the subsequent subsection.

4.2 SDR with reduced RLT (SDR+RRLT)

Before starting the procedure, we convert the boolean variables x ∈ {0, 1}n to a continuous interval such as x ∈ [0, 1]n . Following the RLT procedure, given the lower and upper bound as 0 and 1 we define the bound factors as x j ≥ 0 and x j − 1 ≤ 0 for all j = 1, 2, ..., n.

Let us define a 2(m + n) × n matrix à and a 2(m + n) × 1 vector b~ such that A~=diag(en)-diag(en)A-A and b~=-enonem-em where e n , e m are vectors of ones of order n and m respectively and o n is the vector of zeros of order n and A is the matrix taken from (7). Following the procedure in Sherali et al. (2012), we propose the following RLT condition acronym as RRLT:

k = 1 2 ( m + n ) j = 1 2 ( m + n ) ( A ~ k x + b ~ k ) ( A ~ j x + b ~ j ) 0 . (13)

Adding the RRLT to the semidefinite relaxation (6), we obtain the following relaxation of problem (4):

min Q ¯ X s.t. D k X = 1 for k = 1 , 2 , , m , diag ( X ) = x , k = 1 2 ( m + n ) j = 1 2 ( m + n ) ( A ~ k x + b ~ k ) ( A ~ j x + b ~ j ) 0 , 1 x x X 0 . (14)

We name the above relaxed problem as SDR+RRLT.

4.3 Strengthened SDR with reduced RLT (SSDR+RRLT)

Adding the RRLT conditions given in (13) to the problem (9) we obtain the following relaxation named SSDR+RRLT.

min Q ¯ X s.t. A x = e diag ( X ) = x A A X = e e k = 1 2 ( m + n ) j = 1 2 ( m + n ) ( A ~ k x + b ~ k ) ( A ~ j x + b ~ j ) 0 , 1 x x X 0 . (15)

Note that Theorems 2-3 and Proposition 1 can be extended to the formulation (14) and (15).

5 ENHANCED SEMIDEFINITE RELAXATION (ESDR)

In this section, we introduce a novel enhanced semidefinite relaxation (ESDR) framework for solving BQP-GUB problems. SDR techniques often suffer from a significant relaxation gap due to the relaxation of discrete and nonconvex constraints. To address this limitation, ESDR incorporates additional structural information from the BQP-GUB problem to tighten the relaxation. Specifically, we strengthen the classical SDR by adding redundant quadratic-linear constraints to the original linear equality constraints. These enhancements lead to a tighter convex relaxation and more accurate approximations of the original problem.

To obtain the enhanced semidefinite relaxation of the problem (7) we have to transform it accordingly. It is obvious that the problem (7) is in the form of the following problem:

min f ( x ) = x Q ¯ x s.t. A x = e A x x = e x x j { 0 , 1 } for j = 1 , 2 , , n . (16)

It has an additional quadratic-linear constraint Axx = ex which follows from the equality constraint Ax = e. Enhancement of (7) means that the equality constraint Ax = e is complemented by the quadratic-linear constraint Axx = ex . From section 2 it is clear that in semidefinite relaxation xx is relaxed by the n × n matrix X, hence the additional constraint Axx = ex is transformed as the set of linear equations AX = ex . Using the semidefinite relaxation transformation Xxx , the enhanced semidefinite relaxation (ESDR) of the problem (7) is as follows:

min Q ¯ X s.t. A x = e A X = e x diag ( X ) = x 1 x x X 0 . (17)

Now, in the following theorem, we establish that the ESDR method gives a tight relaxation to the problem (7). We start by proving that it gives a lower bound to the optimal value of the original problem,

Theorem 4.If the problem (7) is feasible then the problem (17) is also feasible. Ifp4*is the optimal value of the problem (17) thenp1*p4*.

Proof. Let x ∈ ℝn be a feasible solution to (7) and set X = xx . As the constraint Ax = e also exists in the problem 7 and the constraint AX = ex clearly follows from the constraint Ax = e, therefore, x satisfies these constraints. From the Theorem 2 it is clear that x also satisfies all the other remaining constraints. Hence (x, X) is a feasible solution to the problem (17). Finally, xQ¯x=Q¯Xp4* as (x, X) is feasible to (17). Hence p1*p4*-. □

Theorem 5.Suppose (x , X ) is an optimal solution of the problem (17) and let x ∈ {0, 1}n . Assume that both x and X satisfying the inequality

Q ¯ X * x * Q ¯ x * . (18)

Then xis an optimal solution to (7) andp1*=p4*. Moreover,Q¯X*=x*Q¯x*.

Proof. If (x , X ) is an optimal solution to the problem (17) and x ∈ {0, 1}n then clearly it satisfies both the constraints of the original problem (7) and therefore, it is a feasible solution of the problem (7). Now, considering the given inequality (18) and Theorem 2 we conclude that p4*=Q¯X*x*Q¯x*p1*p4*. Hence, p1*=p4* and Q¯X*=x*Q¯x*. □

In the next proposition, we present a sufficient condition to ensure inequality (18).

Proposition 2.The inequalityQ¯XxQ¯xholds for any (x, X) feasible to (17) if there exists γ ∈ ℝ such thatQ¯+γAA0.

Proof. Let us assume that Q¯+γAA0 for some γ. It follows from fundamental properties of positive semidefinite matrices that tr(MN) ≥ 0 for any M ⪰ 0, N ⪰ 0, M, N ∈ 𝕊n . Now, if (x, X) is an optimal solution to (17), then M = Xxx ⪰ 0. Consequently, 0tr((Q¯+γAA)(X-xx))=tr(Q¯X+γAAX-Q¯xx-γAAxx) =tr(Q¯X-Q¯xx)+γtr(AAX)-γtr(AAxx)=tr(Q¯X-Q¯xx)+γtr(Aex)-γtr(Aex)=tr(Q¯X-Q¯xx)=tr(Q¯X)-xQ¯x, because AX = ex and Ax = e for any (x, X) feasible to (17). Hence, Q¯XxQ¯x. □

6 VECTOR LIFTING SEMIDEFINITE RELAXATION (VSDR)

Yichuan Ding and Henry Wolkowicz discussed a method in Ding & Wolkowicz (2009) to relax a quadratically constrained quadratic programming problem (QCQP) using the vector lifting approach. It refers to a specific reformulation approach where quadratic expressions on a variable x ∈ ℝn are transformed into the linear form by lifting the vector variable into the space of (n + 1) ×(n + 1) matrices. The proposed relaxation method is an extension of that method.

Let us define matrices, Z=1xxX,Q~=0oo-Q and Ck~=012ck12ckO where X ∈ 𝕊n is a symmetric matrix, x n×1 is vector, o n×1 is a zero vector, and finally, for k = 1, 2, . . . , m, c k is k th row of the matrix A defined in (7) and O is a null matrix of order n × n. The constraints of the problem (7) can be linearized using the vector 1xn+1. i.e., the constraints can be presented as trace012ck12ckO1x1x=trace012ck12ckO1xxX. Using Schur complement we get the lifted linear constraint Z ⪰ 0 where ZS n+1 . Then we formulate the problem (7) as:

min tr ( Q ~ Z ) s.t. tr ( C k ~ Z ) = 1 for k = 1 , 2 , , m diag ( X ) = x Z 0 . (19)

Now we claim that the proposed formulation gives a semidefinite relaxation to the problem (7). In the following Theorem, we prove that problem (19) is feasible and it gives a lower bound to the optimal value of the problem (7).

Theorem 6.If the problem (7) is feasible then the problem (19) is also feasible. Ifp5*is optimal value of the problem (19) thenp1*p5*.

Proof. Let x ∈ ℝn be a feasible solution to (7) and set X = xx .

For k = 1, 2, ..., m, the constraints 1=tr(Ck~Z)=tr012ck12ckO1xxX=12(tr(ckx)+ckx)=12(ckx+ckx)=ckx=jCkxj which gives jCkxj=1. Hence (x,X) satisfies the general upper bound constraint of (7). The constraint diag(X ) = x is obtained from the condition X = xx . Hence (x, X ) is a feasible solution to the problem (19). Finally, xQ¯x=-QX=Q~Zp5* as (x, X) is feasible to (19). Hence p1*p5*-. □

7 MATRIX LIFTING SEMIDEFINITE RELAXATION (MSDR)

Matrix lifting semidefinite relaxation (MSDR) is another optimization technique used to tackle problems involving non-convex quadratic programming problems. Similar to the VSDR method, MSDR also uses semidefinite program to obtain a convex relaxation of the original problem. However, instead of introducing new high-dimensional vectors as in the VSDR method, MSDR directly lifts the original variables into a space of matrices. In the research by Ding & Wolkowicz (2009) the MSDR relaxation technique is used for the relaxation of QCQP. We extend it for BQP-GUB.

Let us define a n × n matrix Y and a n × r matrix X . For k = 1, 2, . . . , m, let us define a n × r matrix A¯k as A¯k=AkOnr where, A k is k th row of the matrix A defined in (7) and O nr is the zero matrix of order n ×(r − 1). Then the constraint Ax = e from the problem (7) can be written as trace(A¯kX)-1=0 for k = 1, 2, . . . , m. The boolean constraint x j ∈ {0, 1} for j = 1, 2, . . . , n from problem (7) can be presented as x 2x = 0.

Letting B j as a matrix of order n × n defined by

( B j ) p q = 1 when p = q = j 0 otherwise,

and B~j as a matrix of order n × r defined by

B ~ j p q = - 1 when p = j and q = 1 0 otherwise,

the boolean constraint equation can be written as xBjx+B~jx=0 for j = 1, 2, . . . , n. Thus, rewriting the problem (7) as a QCQP and converting it in terms of matrix variable we got (acronym as MQCQP)

min X Q ¯ X s.t. trace ( A ¯ k X ) - 1 = 0 for k = 1 , 2 , , m X B j X + trace ( B ~ j X ) = 0 for j = 1 , 2 , , n X n × r . (20)

Now, using the transformation Y = XX , and relax it by YXX and using the Schur complement, we obtain the lifted linear constraint IXXY0. Hence, the MSDR relaxation of the problem (7) is:

min Q ¯ Y s.t. trace ( A ¯ k X ) - 1 = 0 for k = 1 , 2 , , m B j Y + trace ( B ~ j X ) = 0 for j = 1 , 2 , , n I X X Y 0 . (21)

From Beck (2007) and Beck & Teboulle (2000), it is clear that if rn and the Slater constraint qualification is satisfied, then MSDR can solve the MQCQP.

8 ALTERNATIVE ENHANCED SEMIDEFINITE RELAXATION (AESDR)

The enhanced semidefinite relaxation of the problem (7) is discussed in section 5. Following this approach, we directly obtain the enhanced semidefinite relaxation of the problem (2) as follows:

min - ( R X + p x ) s.t. A x = e A X = e x diag ( X ) = x 1 x x X 0 . (22)

Here, we propose an alternative enhanced semidefinite relaxation to the BQP-GUB problem (2) where we do not consider the RLT conditions. In this relaxation, we define a new vector y based on the boolean variables x i and their boolean properties. Subsequently, we adjust the objective function and all constraints of the original problem (2) accordingly.

For i = 1, 2, ..., n, let us define a vector y=yiyn+i=xi2-xi=x2-x. We again define Q^=Rn×nOn×nOn×nRn×n,c^=pn×1on×1,A^=Am×nOm×n, where A m×n is defined in (7). Defining Y = yy AESDR is:

min - 1 2 ( Q ^ Y ) - c ^ y s.t. A ^ y = e A ^ Y = e y Y ( i , i ) - Y ( n + i , n + i ) = 0 for i = 1 , 2 , , n diag ( Y ) = y 1 y y Y 0 . (23)

Now we will show that the proposed method gives a lower bound to the original problem

Theorem 7. If the problem (7) is feasible then the problem (23) is also feasible. If p 7 * is the optimal value of the problem (23) then p 1 * p 7 * .

Proof. Let x ∈ ℝn be a feasible solution to (7) and set X = xx and Y = yy . Consider the first constraint of the problem (23), e=A^y=AOm×nx2-x=AOm×nx-x=Ax. The second constraint is directly followed by the first constraint by multiplying y to the RHS of the first constraint. The third constraint is simplified as: Y(i,i)-Y(n+i,n+i)=yi2-yn+i2=xi4-xi2=0. The constraint diag(Y ) = y is the relaxation of the boolean constraint and 1yyY0 is the semidefinite relaxation of Y = yy . As (x, X) satisfies all the constraints of the problem (23), therefore, it is a feasible solution to the problem (23). Finally, the objective function -12(Q^Y)-c^y=-12tr(Q^Y)-c^y=-12tr(Q^Y)-c^y=-12yQ^y-c^y=-12x-xROORx-x-pox-x=-xRx-px which is the negative of the objective function of the problem (2) and it is equal to the objective function of the problem (7). Therefore, xQ¯x=-12(Q^Y)-c^yp7* as (x, X) is feasible to 23, hence p1*p7*-. □

We establish that the proposed method provides a semidefinite relaxation to the problem (7).

Insight into tightness and equivalence.

The performance of SDP relaxations reflects the strength of constraints used to approximate the feasible region. RRLT introduces additional valid quadratic constraints, producing tighter convex approximations and often near-tight bounds. In contrast, formulations such as SDR, VSDR, MSDR, SSDR, and ESDR are theoretically or numerically equivalent, yielding identical bounds.

Hence, improvements arise mainly from stronger constraints (e.g., RRLT) rather than structural differences among baseline SDP models. These results highlight a trade-off: stronger relaxations enhance bound quality but increase computational complexity, limiting scalability for larger instances.

8.1 A Combined SDP Relaxation

If the constraint of the SSDR relaxation 3 is incorporated into the VSDR 6 and MSDR 7 relaxations, the resulting solutions will be equivalent to those produced by the SSDR relaxation alone. Similarly, applying RLT conditions to the VSDR 6 and MSDR 7 relaxations will yield results similar to those obtained from the SDR+RRLT 4.2 and SSDR+RRLT 4.3 relaxations. However, the combined relaxations come with the drawback of increased computational time.

9 RELATIONS BETWEEN THE SDP BOUNDS

In this section we discuss the relation between all the proposed bounds. We claim the following results based on our analysis and observations.

Theorem 8 (Bound Theorem).

  • (i) The bounds obtained from SDR+RRLT, SSDR, SSDR+RRLT, ESDR, and AESDR dominate the bounds obtained from SDR, VSDR, and MSDR.

  • (ii) The relaxations SDR, VSDR, and MSDR yield the same bound. Similarly, the bounds obtained from SDR+RRLT and SSDR+RRLT coincide, and the bounds obtained from SSDR and ESDR are identical.

Proof. The argument relies on two principles: (a) feasible-set inclusion, and (b) equivalence of lifted formulations established in Theorems 1-7.

  • (i) Dominance of strengthened relaxations. For a minimization problem, if the feasible set of the relaxations are ℱ1 and ℱ2 with ℱ1 ⊆ ℱ2, then v(ℱ1) ≥ v(ℱ2).

SDR+RRLT augments SDR with reduced RLT constraints valid for all feasible solutions of BQP-GUB. Hence

F ( SDR+RRLT ) F ( SDR ) v ( SDR+RRLT ) v ( SDR ) .

SSDR strengthens SDR by adding the redundant quadratic constraint x A Ax = e e, relaxed as A AX = e e. Thus

F ( SSDR ) F ( SDR ) v ( SSDR ) v ( SDR ) .

ESDR replaces this quadratic constraint with the equivalent lifted linear constraint AX = ex , yielding

F ( ESDR ) F ( SSDR ) F ( SDR ) , v ( ESDR ) v ( SSDR ) v ( SDR ) .

AESDR further adds affine equalities valid for all feasible solutions, so

F ( AESDR ) F ( ESDR ) v ( AESDR ) v ( ESDR ) .

Finally, SSDR+RRLT strengthens SSDR by RRLT inequalities:

F ( SSDR+RRLT ) F ( SSDR ) v ( SSDR+RRLT ) v ( SSDR ) .

In contrast, VSDR and MSDR are alternative liftings of SDR without additional valid constraints. Thus all strengthened relaxations dominate SDR, VSDR, and MSDR.

  • (ii) Equality of bounds. By Theorems 1 and 6, SDR, VSDR, and MSDR are equivalent liftings of the same convex hull:

v ( SDR ) = v ( VSDR ) = v ( MSDR ) .

Under RRLT constraints, the quadratic condition AA • X = ee is redundant. Hence

v ( SDR+RRLT ) = v ( SSDR+RRLT ) .

Finally, SSDR and ESDR impose equivalent restrictions (x A Ax = e e vs. AX = ex ), so

v ( SSDR ) = v ( ESDR ) .

Hierarchy of bounds. Collecting all relations, we obtain

v ( SDR ) = v ( VSDR ) = v ( MSDR ) v ( SSDR ) = v ( ESDR ) v ( SDR+RRLT ) = v ( SSDR+RRLT ) ( AESDR ) .

This establishes both dominance and equality claims, completing the proof. □

10 NUMERICAL EXPERIMENTS

In this section, we present some numerical results to illustrate the performance of the proposed methods on BQP-GUB problems and their tightness. Each method is applied to various dimensions of BQP-GUB problems to evaluate their performance. We take 44 BQP-GUB instances, with dimensions ranging from 20 to 500, from the dataset generated by the authors which are available at BQP-GUB (https://sites.google.com/a/iiit-bh.ac.in/r-k-nayak/bqp-bqp-problems/bqp-gub-problems). These instances are randomly generated using the procedure described by Wang & Punnen (2017). The coefficients p i and r ij are pseudo-random real numbers within the range of −50 to 50. All algorithms are implemented in MATLAB 2022a on a machine equipped with an Intel Core i3 processor (3.20 GHz) and 8 GB RAM. The global optimization solver Knitro (Byrd et al., 2006; Fontan et al., 2022) is used to obtain benchmark solutions, while semidefinite programs are solved using CVX (Grant et al., 2009) with the MOSEK solver (MOSEK, 2017).

Numerical results were obtained by all methods for the objective values; however, Table 1 summarizes only the results for Knitro, SDR, SSDR, SDR+RRLT, ESDR, and AESDR for dimensions n = 20, 50, 100, 200, and 500. In the Observation section 10.1, we have clarified the reason for this omission of the other methods.

Table 1
Value comparison.

Knitro provides the lower bound, while the objective values returned by the other methods serve as upper bounds for the problem. Note that ∗ indicates that the method fails to produce the optimal solution. We observed in Table 1 that adding RRLT to different methods makes the problem high dimensional and thereby fails to achieve an optimal solution in the specified system. Although ESDR, VSDR, MSDR, and AESDR are free from RRLT, they also fail to achieve the optimal solution except for VSDR and MSDR.

Since for n = 20 and n = 50, all the methods are producing optimal solutions and some of the problems fail to produce it, for other high dimensional problems, we prefer to obtain the gaps for n = 20 and n = 50 only. To obtain the gaps between the lower bound (LB) and the corresponding upper bounds (UB) we calculate the the gaps by (UB - LB) which are presented in Table 2. The gaps between the methods SDR, SSDR, SDR+RRLT, ESDR, and AESDR and the values obtained using Knitro are presented in Table 2. In Table 2, the symbol ∗ denotes cases where the gap could not be computed due to the unavailability of the corresponding optimal value.

Table 2
Comparison of the gaps between the methods SDR, SSDR, SDR+RRLT, ESDR, and AESDR with the values obtained using Knitro for n = 20 and 50. An asterisk (∗) indicates that the gap could not be computed due to the unavailability of the corresponding optimal value.

From Table 2, one can observe that the GapSDRR is the lowest among others. Now to illustrate the tightness of our proposed methods we compare the objective values with the benchmark values obtained by Knitro. Therefore, to measure the tightness of SDR+RRLT over other methods, we calculate the improved ratio (impr. ratio) by the formula

i m p r . r a t i o = v ( S D R + R R L T ) - v ( d e s i r e d m e t h o d ) v ( k n i t r o ) - v ( d e s i r e d m e t h o d ) (24)

In Table 3, Columns 2-5 represent the improved ratio computed by (24) of SDR+RRLT over the other methods denoted by (SDR+RRLT, other method). We see that SDR+RRLT often generates a tighter upper bound than the other discussed method.

Table 3
Improved ratio of SDR+RRLT over other methods.

10.1 Observations from numerical experiments

  • We observed that both VSDR and MSDR consistently produce bounds identical to those obtained from the classical SDR. As their numerical outcomes coincide exactly across all tested instances, we have omitted separate columns for VSDR and MSDR in Tables 1-3.

  • Minor discrepancies were noted between the SSDR and ESDR values, which can be attributed to solver precision and differences in constraint encoding. These variations do not affect the theoretical equivalence of the two relaxations. It is worth emphasizing that in SSDR, strengthening is achieved through the inclusion of redundant quadratic norm constraints, whereas in ESDR it is enforced via quadratic-linear consistency constraints.

  • The SDR+RRLT and SSDR+RRLT formulations produce identical theoretical and numerical bounds for all instances where both methods converge. However, SSDR+RRLT fails to converge within the prescribed time limit for the instances bqpgub-100-1 to bqpgub-100-5 and bqpgub-200-1 to bqpgub-200-5. For larger problem sizes (e.g., dimension 500), neither formulation is able to compute bounds within the allotted time.

In view of this equivalence in solution quality, we report only the SDR+RRLT results in Tables 1-3 to avoid redundancy.

  • Figure 1 compares the objective values obtained by different semidefinite relaxations for BQP-GUB with problem sizes n = 20 to n = 50. The classical SDR yields loose bounds, while SSDR improves tightness by adding redundant quadratic constraints. Incorporation of reduced RLT (SDR+RRLT and SSDR+RRLT) significantly strengthens the relaxation, often matching the exact solution and thereby minimizing the relaxation gap. Enhanced relaxations (ESDR, AESDR) provide tighter bounds for small instances but face scalability issues. Overall, SDR+RRLT emerges as the most effective method, combining tightness with computational efficiency. In particular, SDR+RRLT achieves the best balance of tightness and numerical performance in moderate dimensions, whereas SDR and SSDR remain consistently feasible for large-scale cases.

  • Figure 2 illustrates the relaxation gap versus problem size. It highlights the trade-off between tightness and scalability: RLT-based relaxations are superior for small to medium problems, while SSDR, VSDR, and MSDR remain practical for large-scale instances.

Figure 1
Objective value obtained by different relaxations for n=20 to n=50.

Figure 2
Relaxation gap vs. problem size for different SDR methods.

10.2 Performance Profiles

If a problem is deemed “solved” whenever a feasible solution is obtained, irrespective of its quality, the resulting conclusions may be misleading. In particular, such a definition may suggest that methods such as SDR, VSDR, and MSDR solve all problems, even when their objective values are inferior to those produced by other relaxations. To ensure a fair comparison, we adopt a stricter criterion: a method is considered successful only if it attains the best objective value among all competitors (within a prescribed tolerance); otherwise, it is classified as unsuccessful.

For all reported instances, SDR, SSDR, VSDR, and MSDR successfully produce feasible solutions, whereas other relaxations fail to converge for higher-dimensional problems. Consequently, for solution quality comparison, we focus on these methods. Under this criterion, SSDR consistently achieves the best objective values.

Moreover, for instances in which multiple methods achieve equivalent objective values (within a prescribed tolerance), we employ group-based performance profiles that compare computational efficiency. In this setting, we consider the CPU times of SDR, VSDR, and MSDR, as these methods yield identical objective values within the specified tolerance.

Figure 3
Performance profile of CPU time for SDR, VSDR, and MSDR.

To compare computational efficiency, we analyze CPU time using the Dolan-Moré performance profile (Dolan & Moré, 2002). As shown in Fig. 3, MSDR appears as the dominant method within this group, indicating superior performance in terms of CPU time.

In addition to the group-based comparison, we construct a global performance profile that includes all instances and all methods. For each problem and method, the performance ratio is defined relative to the best-performing method in terms of CPU time, provided that the method attains the best objective value (within a tolerance of 10−6). Otherwise, including cases where a method produces an inferior objective value or fails to converge within the time limit, it is treated as unsuccessful and assigned an infinite performance ratio.

Following the Dolan-Moré framework (Dolan & Moré, 2002), such unsuccessful cases result in curves that may not reach one, thereby reflecting both computational efficiency and robustness.

Figure 4
Performance profile considering all instances and all methods.

The resulting performance profile is shown in Fig. 4. It can be observed that MSDR dominates the other methods over a large range of performance ratios, indicating superior computational efficiency. In contrast, SSDR performs best on a subset of instances, achieving higher probabilities in certain regions, which reflects its competitiveness in terms of robustness. In addition, the methods SSDR+RRLT, ESDR, and AESDR are consistently reported as failures, confirming their lack of practical competitiveness in this study.

10.3 Comparison of Semidefinite Relaxations for BQP-GUB

Table 4 provides an overall comparison of semidefinite relaxations for BQP-GUB.

Table 4
Comparison of semidefinite relaxations for BQP-GUB.

11 CONCLUSION

In this paper, we studied semidefinite programming (SDP) relaxations for the BQP-GUB problem through a unified theoretical and computational framework. We showed that several formulations, including SDR, VSDR, and MSDR, as well as SSDR and ESDR, are equivalent in terms of bound quality. Our results indicate that improvements in relaxation strength arise primarily from the incorporation of stronger valid constraints, particularly reduced reformulation linearization techniques (RRLT), rather than from alternative SDP formulations. RRLT-based relaxations, such as SDR+RRLT and SSDR+RRLT, yield tight or near-tight bounds and significantly reduce the relaxation gap. However, this comes at the expense of increased computational cost, limiting their scalability for large-scale instances, whereas simpler relaxations remain computationally efficient.

Overall, the study clarifies the relationships among SDP formulations for BQP-GUB and high-lights the trade-off between bound quality and computational scalability. Future work will focus on developing scalable strengthened relaxations and exploiting problem structure to improve efficiency.

Acknowledgements

This research work is fully supported by the National Board for Higher Mathematics (NBHM), Department of Atomic Energy, Govt. of India (Grant no. 02011/22/2021 NBHM (R.P.)/R&D II/900 Date 06/08/2021).

Data Availability

The datasets analyzed during the current study are available on the web address: BQP-GUB (https://sites.google.com/a/iiit-bh.ac.in/r-k-nayak/bqp-bqp-problems/bqp-gub-problems).

References

  • ANSTREICHER K, CHEN X, WOLKOWICZ H & YUAN YX. 1999. Strong duality for a trust-region type relaxation of the quadratic assignment problem. Linear Algebra and its Applications, 301(1-3): 121-136.
  • ANSTREICHER K & WOLKOWICZ H. 2000. On Lagrangian relaxation of quadratic matrix constraints. SIAM Journal on Matrix Analysis and Applications, 22(1): 41-55.
  • ANSTREICHER KM. 2009. Semidefinite programming versus the reformulation-linearization technique for nonconvex quadratically constrained quadratic programming. Journal of Global Optimization, 43: 471-484.
  • BECK A. 2007. Quadratic matrix programming. SIAM Journal on Optimization, 17(4): 1224-1238.
  • BECK A & TEBOULLE M. 2000. Global optimality conditions for quadratic optimization problems with binary constraints. SIAM Journal on Optimization , 11(1): 179-188.
  • BOYD S & VANDENBERGHE L. 2004. Convex optimization. Cambridge university press.
  • BYRD RH, NOCEDAL J & WALTZ RA. 2006. Knitro: An integrated package for nonlinear optimization. Large-scale nonlinear optimization, pp. 35-59.
  • CHHAJED D & LOWE TJ. 1992. m-median and m-center problems with mutual communication: Solvable special cases. Operations Research, 40(1-supplement-1): S56-S66.
  • CHRÉTIENNE P. 1989. A polynomial algorithm to optimally schedule tasks on a virtual distributed system under tree-like precedence constraints. European Journal of Operational Research, 43(2): 225-230.
  • DEMAINE ED, EMANUEL D, FIAT A & IMMORLICA N. 2006. Correlation clustering in general weighted graphs. Theoretical Computer Science, 361(2-3): 172-187.
  • DING Y & WOLKOWICZ H. 2009. A low-dimensional semidefinite relaxation for the quadratic assignment problem. Mathematics of Operations Research , 34(4): 1008-1022.
  • DOLAN ED & MORÉ JJ. 2002. Benchmarking optimization software with performance profiles. Mathematical programming, 91(2): 201-213.
  • FAYE A & ROUPIN F. 2007. Partial Lagrangian relaxation for general quadratic programming. 4OR, 5: 75-88.
  • FINSLER P. 1937. Uber das vorkommen definiter und semidefiniter formen in scharen quadraticher formen. Commentarii Mathematici Helvetici, 1: 19-28.
  • FONTAN F, FERREIRA A, BUSCAYLET F & ALIOUAT I. 2022. Résolution de problèmes MINLP avec Artelys Knitro 13.0. In: 23ème congrès annuel de la Société Française de Recherche Opérationnelle et d’Aide à la Décision.
  • GELENBE E, TIMOTHEOU S & NICHOLSON D. 2010. Fast distributed near-optimum assignment of assets to tasks. The Computer Journal, 53(9): 1360-1369.
  • GRANT M, BOYD S & YE Y. 2009. CVX: Matlab software for disciplined convex programming.
  • GREENBERG H. 1969. A quadratic assignment problem without column constraints. Naval Research Logistics Quarterly, 16(3): 417-421.
  • GUATTERY S & MILLER GL. 1998. On the quality of spectral separators. SIAM Journal on Matrix Analysis and Applications , 19(3): 701-719.
  • HEILER M, KEUCHEL J & SCHNÖRR C. 2005. Semidefinite clustering for image segmentation with a-priori knowledge. In: Joint Pattern Recognition Symposium. pp. 309-317. Springer.
  • JOULIN A, BACH F & PONCE J. 2010. Discriminative clustering for image co-segmentation. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp. 1943-1950. IEEE.
  • KANNAN R, VEMPALA S & VETTA A. 2004. On clusterings: Good, bad and spectral. Journal of the ACM (JACM), 51(3): 497-515.
  • KLEINBERG J & TARDOS E. 2002. Approximation algorithms for classification problems with pairwise relationships: Metric labeling and Markov random fields. Journal of the ACM (JACM) , 49(5): 616-639.
  • LANG K. 2005. Fixing two weaknesses of the spectral method. Advances in Neural Information Processing Systems, 18.
  • MOSEK A. 2017. The MOSEK optimization toolbox for MATLAB manual, version 8.0 (Revision 60).
  • NAYAK RK & MOHANTY NK. 2019. Improved row-by-row method for binary quadratic optimization problems. Annals of Operations Research , 275(2): 587-605.
  • SCHELLEWALD C & SCHNÖRR C. 2005. Probabilistic subgraph matching based on convex relaxation. In: International Workshop on Energy Minimization Methods in Computer Vision and Pattern Recognition. pp. 171-186. Springer.
  • SHERALI HD & ADAMS WP. 2013. A reformulation-linearization technique for solving discrete and continuous nonconvex problems. vol. 31. Springer Science & Business Media.
  • SHERALI HD, DALKIRAN E & LIBERTI L. 2012. Reduced RLT representations for nonconvex polynomial programming problems. Journal of Global Optimization , 52: 447-469.
  • VITALADEVUNI SN & BASRI R. 2010. Co-clustering of image segments using convex optimization applied to EM neuronal reconstruction. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. pp. 2203-2210. IEEE.
  • WANG Y & PUNNEN AP. 2017. The boolean quadratic programming problem with generalized upper bound constraints. Computers & Operations Research , 77: 1-10.
  • ZHAO Q, KARISCH SE, RENDL F & WOLKOWICZ H. 1998. Semidefinite programming relaxations for the quadratic assignment problem. Journal of Combinatorial Optimization, 2: 71-109.

Edited by

  • Editor responsible for the review
    Editor-in-Chief: Antônio Augusto Chaves

Publication Dates

  • Publication in this collection
    31 July 2026
  • Date of issue
    2026

History

  • Received
    16 Sept 2025
  • Accepted
    21 May 2026
location_on
Sociedade Brasileira de Pesquisa Operacional Rua Mayrink Veiga, 32 - sala 601 - Centro, 20090-050 , Tel.: +55 21 2263-0499 - Rio de Janeiro - RJ - Brazil
E-mail: sobrapo@sobrapo.org.br
rss_feed Acompanhe os números deste periódico no seu leitor de RSS
Ir para o topo Reportar erro