Duality in mixed integer linear programsTightness of an LP relaxation without using objective functionProve that these linear programming problems are bounded by $O(k^1/2)$Recovering primal optimal solutions from dual sub gradient ascent using ergodic primal sequencesAre valid inequalities worth the effort given modern solvers?Mixed-Integer Linear Programming (Capacity Planning)State-of-the-art algorithms for solving linear programsValid Inequalities and Strong InequalitiesFinding the linear functions defining a polyhedron through integer data?Variable fixing based on a good feasible solution
How do I handle a paladin who falls, but wants to choose a different class instead of taking the Oathbreaker subclass?
Dealing with recruiters who clearly didn't look at my resume
Why does it seem everything I push moves at a constant velocity?
Are snow shoes useful in mountaineering?
Outlook not so good
Z80 CPU address lines not stable
How many photos should I take If I'm given a camera to take a picture?
Simple n-body class in C++
Why is Ian Blackford allowed to speak in the Commons while having crossed the line?
Is there an algorithm for determining whether an expression involving nested radicals is rational?
If authors misuse diacritics, should I correct them or leave it as written?
Can a fighter with the Great Weapon Fighting fighting style reroll his damage many times?
Is there more concise way to say "tomorrow morning" than "mañana por la mañana"?
The DM is unapologetically providing TPK encounters; what can we do?
Why wasn't Captain America eating in the end of The Avengers?
Are independent variables necessarily "independent" and how does this relate to what's being predicted?
Best way to get my money back from a friend having family problems
Should I correct a mistake on an arXiv manuscript, that I found while refereeing it?
7zip seems unable to compress zero-filled virtual disk image after 1.8 Gb
How Would Civilisations on Different Planes of a Cube Planet Interact?
Is 2FA via mobile phone still a good idea when phones are the most exposed device?
180W Laptop charged with 45W charger, is it dead?
Practically, how does an 'observer' collapse a wave function?
During World War 1, were any policies were in place to handle large scale troop mutiny?
Duality in mixed integer linear programs
Tightness of an LP relaxation without using objective functionProve that these linear programming problems are bounded by $O(k^1/2)$Recovering primal optimal solutions from dual sub gradient ascent using ergodic primal sequencesAre valid inequalities worth the effort given modern solvers?Mixed-Integer Linear Programming (Capacity Planning)State-of-the-art algorithms for solving linear programsValid Inequalities and Strong InequalitiesFinding the linear functions defining a polyhedron through integer data?Variable fixing based on a good feasible solution
$begingroup$
I know that the standard duality theory for the linear programming problem does not hold for mixed integer linear programming problems. I was wondering why an integer program does not have a dual problem and whether this extends to any integer program?
For example, an integer program with a totally unimodular coefficient matrix has integral extreme points. Does this property hold for the dual of such a linear program? What can be said about duality of integer programs in general?
mixed-integer-programming linear-programming integer-programming combinatorial-optimization duality
$endgroup$
add a comment
|
$begingroup$
I know that the standard duality theory for the linear programming problem does not hold for mixed integer linear programming problems. I was wondering why an integer program does not have a dual problem and whether this extends to any integer program?
For example, an integer program with a totally unimodular coefficient matrix has integral extreme points. Does this property hold for the dual of such a linear program? What can be said about duality of integer programs in general?
mixed-integer-programming linear-programming integer-programming combinatorial-optimization duality
$endgroup$
add a comment
|
$begingroup$
I know that the standard duality theory for the linear programming problem does not hold for mixed integer linear programming problems. I was wondering why an integer program does not have a dual problem and whether this extends to any integer program?
For example, an integer program with a totally unimodular coefficient matrix has integral extreme points. Does this property hold for the dual of such a linear program? What can be said about duality of integer programs in general?
mixed-integer-programming linear-programming integer-programming combinatorial-optimization duality
$endgroup$
I know that the standard duality theory for the linear programming problem does not hold for mixed integer linear programming problems. I was wondering why an integer program does not have a dual problem and whether this extends to any integer program?
For example, an integer program with a totally unimodular coefficient matrix has integral extreme points. Does this property hold for the dual of such a linear program? What can be said about duality of integer programs in general?
mixed-integer-programming linear-programming integer-programming combinatorial-optimization duality
mixed-integer-programming linear-programming integer-programming combinatorial-optimization duality
asked Oct 14 at 11:11
OptOpt
54513 bronze badges
54513 bronze badges
add a comment
|
add a comment
|
1 Answer
1
active
oldest
votes
$begingroup$
It is a difference whether one can dualize (or not) or that a duality theory holds (or not). Formally, you can formulate a dual of any integer program, e.g., by considering the linear relaxation, dualizing it, and then enforcing integrality again on the dual variables. It is already trickier which variables to consider as integer in the dual when you dualize a mixed-integer program; but for integer programs, this formally works.
When you are lucky, as in the cases you mention, e.g., that the coefficient matrix is TU (and the cost and RHS are integral), then the dual possesses the same nice properties as the primal, essentially since transposing a matrix (what happens when you dualize) does not destroy TUness.
However, when you are unlucky, and this is what you usually are, the matrix does not have any such special property, neither the primal nor the dual are integer when only solving the linear relaxations. So, still, when you consider the two LP relaxations (the primal and the dual), of course they have the same objective function value (strong duality), after all, this is how you constructed the dual. Yet, when you impose integrality again, on the primal and the dual, you usually do not get the same objective function value, there remains a duality gap.
You may consider the maximum (cardinality) matching problem on a general undirected graph $G=(V,E)$. You have a variable $x_ijin0,1$ whether edge $ijin E$ is in the matching or not. The classic model reads $$maxleft.leftsum_ijin Ex_ij ,,rightvert,, sum_ijin E x_ijleq1 ;forall iin V,; x_ijin0,1; forall ijin Erightenspace.$$ If you relax this, dualize (with a dual variable $y_i$ per vertex $iin V$), and impose integrality on the $y$-variables again, you obtain $$min left.leftsum_iin Vy_i ,,rightvert,, y_i+y_jgeq1 ;forall ijin E,; y_iin0,1; forall iin Vrightenspace,$$ which is the minimum vertex cover problem on $G$. If you consider a cycle of odd length, say length 5, you can match at most 2 pairs, but for covering all the edges you need at least 3 nodes, so the optima do not coincide. If $G$, however, is bipartite (like for a cycle of even length), the underlying node-edge incidence matrix is TU, and strong duality holds for the integer programs because they are, in fact, linear programs.
$endgroup$
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
add a comment
|
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "700"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/4.0/"u003ecc by-sa 4.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2for.stackexchange.com%2fquestions%2f2817%2fduality-in-mixed-integer-linear-programs%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
It is a difference whether one can dualize (or not) or that a duality theory holds (or not). Formally, you can formulate a dual of any integer program, e.g., by considering the linear relaxation, dualizing it, and then enforcing integrality again on the dual variables. It is already trickier which variables to consider as integer in the dual when you dualize a mixed-integer program; but for integer programs, this formally works.
When you are lucky, as in the cases you mention, e.g., that the coefficient matrix is TU (and the cost and RHS are integral), then the dual possesses the same nice properties as the primal, essentially since transposing a matrix (what happens when you dualize) does not destroy TUness.
However, when you are unlucky, and this is what you usually are, the matrix does not have any such special property, neither the primal nor the dual are integer when only solving the linear relaxations. So, still, when you consider the two LP relaxations (the primal and the dual), of course they have the same objective function value (strong duality), after all, this is how you constructed the dual. Yet, when you impose integrality again, on the primal and the dual, you usually do not get the same objective function value, there remains a duality gap.
You may consider the maximum (cardinality) matching problem on a general undirected graph $G=(V,E)$. You have a variable $x_ijin0,1$ whether edge $ijin E$ is in the matching or not. The classic model reads $$maxleft.leftsum_ijin Ex_ij ,,rightvert,, sum_ijin E x_ijleq1 ;forall iin V,; x_ijin0,1; forall ijin Erightenspace.$$ If you relax this, dualize (with a dual variable $y_i$ per vertex $iin V$), and impose integrality on the $y$-variables again, you obtain $$min left.leftsum_iin Vy_i ,,rightvert,, y_i+y_jgeq1 ;forall ijin E,; y_iin0,1; forall iin Vrightenspace,$$ which is the minimum vertex cover problem on $G$. If you consider a cycle of odd length, say length 5, you can match at most 2 pairs, but for covering all the edges you need at least 3 nodes, so the optima do not coincide. If $G$, however, is bipartite (like for a cycle of even length), the underlying node-edge incidence matrix is TU, and strong duality holds for the integer programs because they are, in fact, linear programs.
$endgroup$
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
add a comment
|
$begingroup$
It is a difference whether one can dualize (or not) or that a duality theory holds (or not). Formally, you can formulate a dual of any integer program, e.g., by considering the linear relaxation, dualizing it, and then enforcing integrality again on the dual variables. It is already trickier which variables to consider as integer in the dual when you dualize a mixed-integer program; but for integer programs, this formally works.
When you are lucky, as in the cases you mention, e.g., that the coefficient matrix is TU (and the cost and RHS are integral), then the dual possesses the same nice properties as the primal, essentially since transposing a matrix (what happens when you dualize) does not destroy TUness.
However, when you are unlucky, and this is what you usually are, the matrix does not have any such special property, neither the primal nor the dual are integer when only solving the linear relaxations. So, still, when you consider the two LP relaxations (the primal and the dual), of course they have the same objective function value (strong duality), after all, this is how you constructed the dual. Yet, when you impose integrality again, on the primal and the dual, you usually do not get the same objective function value, there remains a duality gap.
You may consider the maximum (cardinality) matching problem on a general undirected graph $G=(V,E)$. You have a variable $x_ijin0,1$ whether edge $ijin E$ is in the matching or not. The classic model reads $$maxleft.leftsum_ijin Ex_ij ,,rightvert,, sum_ijin E x_ijleq1 ;forall iin V,; x_ijin0,1; forall ijin Erightenspace.$$ If you relax this, dualize (with a dual variable $y_i$ per vertex $iin V$), and impose integrality on the $y$-variables again, you obtain $$min left.leftsum_iin Vy_i ,,rightvert,, y_i+y_jgeq1 ;forall ijin E,; y_iin0,1; forall iin Vrightenspace,$$ which is the minimum vertex cover problem on $G$. If you consider a cycle of odd length, say length 5, you can match at most 2 pairs, but for covering all the edges you need at least 3 nodes, so the optima do not coincide. If $G$, however, is bipartite (like for a cycle of even length), the underlying node-edge incidence matrix is TU, and strong duality holds for the integer programs because they are, in fact, linear programs.
$endgroup$
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
add a comment
|
$begingroup$
It is a difference whether one can dualize (or not) or that a duality theory holds (or not). Formally, you can formulate a dual of any integer program, e.g., by considering the linear relaxation, dualizing it, and then enforcing integrality again on the dual variables. It is already trickier which variables to consider as integer in the dual when you dualize a mixed-integer program; but for integer programs, this formally works.
When you are lucky, as in the cases you mention, e.g., that the coefficient matrix is TU (and the cost and RHS are integral), then the dual possesses the same nice properties as the primal, essentially since transposing a matrix (what happens when you dualize) does not destroy TUness.
However, when you are unlucky, and this is what you usually are, the matrix does not have any such special property, neither the primal nor the dual are integer when only solving the linear relaxations. So, still, when you consider the two LP relaxations (the primal and the dual), of course they have the same objective function value (strong duality), after all, this is how you constructed the dual. Yet, when you impose integrality again, on the primal and the dual, you usually do not get the same objective function value, there remains a duality gap.
You may consider the maximum (cardinality) matching problem on a general undirected graph $G=(V,E)$. You have a variable $x_ijin0,1$ whether edge $ijin E$ is in the matching or not. The classic model reads $$maxleft.leftsum_ijin Ex_ij ,,rightvert,, sum_ijin E x_ijleq1 ;forall iin V,; x_ijin0,1; forall ijin Erightenspace.$$ If you relax this, dualize (with a dual variable $y_i$ per vertex $iin V$), and impose integrality on the $y$-variables again, you obtain $$min left.leftsum_iin Vy_i ,,rightvert,, y_i+y_jgeq1 ;forall ijin E,; y_iin0,1; forall iin Vrightenspace,$$ which is the minimum vertex cover problem on $G$. If you consider a cycle of odd length, say length 5, you can match at most 2 pairs, but for covering all the edges you need at least 3 nodes, so the optima do not coincide. If $G$, however, is bipartite (like for a cycle of even length), the underlying node-edge incidence matrix is TU, and strong duality holds for the integer programs because they are, in fact, linear programs.
$endgroup$
It is a difference whether one can dualize (or not) or that a duality theory holds (or not). Formally, you can formulate a dual of any integer program, e.g., by considering the linear relaxation, dualizing it, and then enforcing integrality again on the dual variables. It is already trickier which variables to consider as integer in the dual when you dualize a mixed-integer program; but for integer programs, this formally works.
When you are lucky, as in the cases you mention, e.g., that the coefficient matrix is TU (and the cost and RHS are integral), then the dual possesses the same nice properties as the primal, essentially since transposing a matrix (what happens when you dualize) does not destroy TUness.
However, when you are unlucky, and this is what you usually are, the matrix does not have any such special property, neither the primal nor the dual are integer when only solving the linear relaxations. So, still, when you consider the two LP relaxations (the primal and the dual), of course they have the same objective function value (strong duality), after all, this is how you constructed the dual. Yet, when you impose integrality again, on the primal and the dual, you usually do not get the same objective function value, there remains a duality gap.
You may consider the maximum (cardinality) matching problem on a general undirected graph $G=(V,E)$. You have a variable $x_ijin0,1$ whether edge $ijin E$ is in the matching or not. The classic model reads $$maxleft.leftsum_ijin Ex_ij ,,rightvert,, sum_ijin E x_ijleq1 ;forall iin V,; x_ijin0,1; forall ijin Erightenspace.$$ If you relax this, dualize (with a dual variable $y_i$ per vertex $iin V$), and impose integrality on the $y$-variables again, you obtain $$min left.leftsum_iin Vy_i ,,rightvert,, y_i+y_jgeq1 ;forall ijin E,; y_iin0,1; forall iin Vrightenspace,$$ which is the minimum vertex cover problem on $G$. If you consider a cycle of odd length, say length 5, you can match at most 2 pairs, but for covering all the edges you need at least 3 nodes, so the optima do not coincide. If $G$, however, is bipartite (like for a cycle of even length), the underlying node-edge incidence matrix is TU, and strong duality holds for the integer programs because they are, in fact, linear programs.
edited Oct 14 at 14:48
answered Oct 14 at 13:05
Marco LübbeckeMarco Lübbecke
2,8459 silver badges36 bronze badges
2,8459 silver badges36 bronze badges
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
add a comment
|
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
I like this answer.
$endgroup$
– independentvariable
Oct 14 at 18:42
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
Thanks Marco. You mentioned integrality of the cost vector. Regarding TU matrices, integrality of extreme points is dependent on the integrality of the right-hand-sides but not the objective function. However, the objective function coefficients form the right-hand-side vector in the dual problem. So what happens when the objective function coefficients are not integral? I think in this case, there exists an optimal basic feasible solution for the dual that is integral, but this is not the case for any extreme point. Is that right?
$endgroup$
– Opt
Oct 14 at 22:50
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
I believe that you can construct a small counter example, take the coefficient matrix 2x2 as identity matrix and fractional objcetive coefficients; isn't then in the dual only one basic solution and it is fractional?
$endgroup$
– Marco Lübbecke
Oct 15 at 3:35
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
$begingroup$
@MarcoLübbecke Yes, nice counterexample!
$endgroup$
– Opt
Oct 15 at 5:26
add a comment
|
Thanks for contributing an answer to Operations Research Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2for.stackexchange.com%2fquestions%2f2817%2fduality-in-mixed-integer-linear-programs%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown