# Optimization and Control

## New submissions

[ total of 35 entries: 1-35 ]
[ showing up to 2000 entries per page: fewer | more ]

### New submissions for Wed, 10 Aug 22

[1]
Title: Designing Drone Delivery Networks for Vaccine Supply Chain: A Case Study of Niger
Comments: 40 pages; 12 Tables; 11 Figures
Subjects: Optimization and Control (math.OC)

The focus of this research is to evaluate the use of drones for the delivery of pediatric vaccines in remote areas of low income and low and middle income countries. Delivering vaccines in these regions is challenging because of the inadequate road networks, and long transportation distances that make it difficult to maintain the cold chain integrity during transportation. We propose a mixed integer linear program to determine the location of drone hubs to facilitate the delivery of vaccines. The model considers the operational attributes of drones, vaccine wastage in the supply chain, cold storage and transportation capacities. We develop a case study using data from Niger to determine the impact of drone deliveries in improving vaccine availability in Niger. Our numerical analysis show an 0.71 to 2.21 increase in vaccine availability. These improvements depend on the available budget to build drone hubs and purchase drones, and the population density in the region of study.

[2]
Title: A Note on Generalizing Power Bounds for Physical Design
Subjects: Optimization and Control (math.OC); Computational Physics (physics.comp-ph); Optics (physics.optics)

In this note we show how to construct a number of nonconvex quadratic inequalities for a variety of physics equations appearing in physical design problems. These nonconvex quadratic inequalities can then be used to construct bounds on physical design problems where the objective is a quadratic or a ratio of quadratics. We show that the quadratic inequalities and the original physics equations are equivalent under a technical condition that holds in many practical cases which is easy to computationally (and, in some cases, manually) verify.

[3]
Title: On the Reinhardt Conjecture and Formal Foundations of Optimal Control
Authors: Koundinya Vajjha
Comments: 180 pages; author's PhD thesis
Subjects: Optimization and Control (math.OC); Metric Geometry (math.MG)

We describe a reformulation (following Hales (2017)) of a 1934 conjecture of Reinhardt on pessimal packings of convex domains in the plane as a problem in optimal control theory. Several structural results of this problem including its Hamiltonian structure and Lax pair formalism are presented. General solutions of this problem for constant control are presented and are used to prove that the Pontryagin extremals of the control problem are constrained to lie in a compact domain of the state space. We further describe the structure of the control problem near its singular locus, and prove that we recover the Pontryagin system of the multi-dimensional Fuller optimal control problem (with two dimensional control) in this case. We show how this system admits logarithmic spiral trajectories when the control set is the circumscribing disk of the 2-simplex with the associated control performing an infinite number of rotations on the boundary of the disk in finite time. We also describe formalization projects in foundational optimal control viz., model-based and model-free Reinforcement Learning theory. Key ingredients which make these formalization novel viz., the Giry monad and contraction coinduction are considered and some applications are discussed.

[4]
Title: Safe Dual Gradient Method for Network Utility Maximization Problems
Comments: 7 pages, 1 figure, published in the proceedings of the 61st IEEE Conference on Decision and Control
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)

In this paper, we introduce a novel first-order dual gradient algorithm for solving network utility maximization problems that arise in resource allocation schemes over networks with safety-critical constraints. Inspired by applications where customers' demand can only be affected through posted prices and real-time two-way communication with customers is not available, we require an algorithm to generate \textit{safe prices}. This means that at no iteration should the realized demand in response to the posted prices violate the safety constraints of the network. Thus, in contrast to existing first-order methods, our algorithm, called the safe dual gradient method (SDGM), is guaranteed to produce feasible primal iterates at all iterations. We ensure primal feasibility by 1) adding a diminishing safety margin to the constraints, and 2) using a sign-based dual update method with different step sizes for plus and minus directions. In addition, we prove that the primal iterates produced by the SDGM achieve a sublinear static regret of ${\cal O}(\sqrt{T})$.

[5]
Title: Adaptive Zeroth-Order Optimisation of Nonconvex Composite Objectives
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)

In this paper, we propose and analyze algorithms for zeroth-order optimization of non-convex composite objectives, focusing on reducing the complexity dependence on dimensionality. This is achieved by exploiting the low dimensional structure of the decision set using the stochastic mirror descent method with an entropy alike function, which performs gradient descent in the space equipped with the maximum norm. To improve the gradient estimation, we replace the classic Gaussian smoothing method with a sampling method based on the Rademacher distribution and show that the mini-batch method copes with the non-Euclidean geometry. To avoid tuning hyperparameters, we analyze the adaptive stepsizes for the general stochastic mirror descent and show that the adaptive version of the proposed algorithm converges without requiring prior knowledge about the problem.

[6]
Title: Splitting algorithms and circuit analysis
Comments: To be presented at MTNS 2022
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)

The splitting algorithms of monotone operator theory find zeros of sums of relations. This corresponds to solving series or parallel one-port electrical circuits, or the negative feedback interconnection of two subsystems. One-port circuits with series and parallel interconnections, or block diagrams with multiple forward and return paths, give rise to current-voltage relations consisting of nested sums and inverses. In this extended abstract, we present new splitting algorithms specially suited to these structures, for interconnections of monotone and anti-monotone relations.

[7]
Title: Risk-averse Stochastic Optimization for Farm Management Practices and Cultivar Selection Under Uncertainty
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)

Optimizing management practices and selecting the best cultivar for planting play a significant role in increasing agricultural food production and decreasing environmental footprint. In this study, we develop optimization frameworks under uncertainty using conditional value-at-risk in the stochastic programming objective function. We integrate the crop model, APSIM, and a parallel Bayesian optimization algorithm to optimize the management practices and select the best cultivar at different levels of risk aversion. This approach integrates the power of optimization in determining the best decisions and crop model in simulating nature's output corresponding to various decisions. As a case study, we set up the crop model for 25 locations across the US Corn Belt. We optimized the management options (planting date, N fertilizer amount, fertilizing date, and plant density in the farm) and cultivar options (cultivars with different maturity days) three times: a) before, b) at planting and c) after a growing season with known weather. Results indicated that the proposed model produced meaningful connections between weather and optima decisions. Also, we found risk-tolerance farmers get more expected yield than risk-averse ones in wet and non-wet weathers.

[8]
Title: Topology Optimization with Frictional Self-Contact
Subjects: Optimization and Control (math.OC)

Contact-aware topology optimization faces challenges in robustness, accuracy, and applicability to internal structural surfaces under self-contact. This work builds on the recently proposed barrier-based Incremental Potential Contact (IPC) model and presents a new self-contact-aware topology optimization framework. A combination of SIMP, adjoint sensitivity analysis, and the IPC frictional-contact model is investigated. Numerical examples for optimizing varying objective functions under contact are presented. The resulting algorithm proposed solves topology optimization for large deformation and complex frictionally contacting scenarios with accuracy and robustness.

[9]
Title: Quantization enabled Privacy Protection in Decentralized Stochastic Optimization
Comments: Accepted to IEEE Transactions on Automatic Control as a full paper. arXiv admin note: text overlap with arXiv:2205.03884
Subjects: Optimization and Control (math.OC); Cryptography and Security (cs.CR); Machine Learning (cs.LG); Systems and Control (eess.SY)

By enabling multiple agents to cooperatively solve a global optimization problem in the absence of a central coordinator, decentralized stochastic optimization is gaining increasing attention in areas as diverse as machine learning, control, and sensor networks. Since the associated data usually contain sensitive information, such as user locations and personal identities, privacy protection has emerged as a crucial need in the implementation of decentralized stochastic optimization. In this paper, we propose a decentralized stochastic optimization algorithm that is able to guarantee provable convergence accuracy even in the presence of aggressive quantization errors that are proportional to the amplitude of quantization inputs. The result applies to both convex and non-convex objective functions, and enables us to exploit aggressive quantization schemes to obfuscate shared information, and hence enables privacy protection without losing provable optimization accuracy. In fact, by using a {stochastic} ternary quantization scheme, which quantizes any value to three numerical levels, we achieve quantization-based rigorous differential privacy in decentralized stochastic optimization, which has not been reported before. In combination with the presented quantization scheme, the proposed algorithm ensures, for the first time, rigorous differential privacy in decentralized stochastic optimization without losing provable convergence accuracy. Simulation results for a distributed estimation problem as well as numerical experiments for decentralized learning on a benchmark machine learning dataset confirm the effectiveness of the proposed approach.

[10]
Title: The economic cost of social distancing during a pandemic: an optimal control approach in the SVIR model
Subjects: Optimization and Control (math.OC); Theoretical Economics (econ.TH); Quantitative Methods (q-bio.QM)

We devise a theoretical model for the optimal dynamical control of an infectious disease whose diffusion is described by the SVIR compartmental model. The control is realized through implementing social rules to reduce the disease's spread, which often implies substantial economic and social costs. We model this trade-off by introducing a functional depending on three terms: a social cost function, the cost supported by the healthcare system for the infected population, and the cost of the vaccination campaign. Using the Pontryagin's Maximum Principle, we give conditions for the existence of the optimal policy, which we characterize explicitly in three instances of the social cost function, the linear, quadratic, and exponential models, respectively. Finally, we present a set of results on the numerical solution of the optimally controlled system by using Italian data from the recent Covid--19 pandemic for the model calibration.

### Cross-lists for Wed, 10 Aug 22

[11]  arXiv:2208.04466 (cross-list from cs.LG) [pdf, ps, other]
Title: Optimal scheduling of entropy regulariser for continuous-time linear-quadratic reinforcement learning
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC); Probability (math.PR); Machine Learning (stat.ML)

This work uses the entropy-regularised relaxed stochastic control perspective as a principled framework for designing reinforcement learning (RL) algorithms. Herein agent interacts with the environment by generating noisy controls distributed according to the optimal relaxed policy. The noisy policies on the one hand, explore the space and hence facilitate learning but, on the other hand, introduce bias by assigning a positive probability to non-optimal actions. This exploration-exploitation trade-off is determined by the strength of entropy regularisation. We study algorithms resulting from two entropy regularisation formulations: the exploratory control approach, where entropy is added to the cost objective, and the proximal policy update approach, where entropy penalises the divergence of policies between two consecutive episodes. We analyse the finite horizon continuous-time linear-quadratic (LQ) RL problem for which both algorithms yield a Gaussian relaxed policy. We quantify the precise difference between the value functions of a Gaussian policy and its noisy evaluation and show that the execution noise must be independent across time. By tuning the frequency of sampling from relaxed policies and the parameter governing the strength of entropy regularisation, we prove that the regret, for both learning algorithms, is of the order $\mathcal{O}(\sqrt{N})$ (up to a logarithmic factor)
over $N$ episodes, matching the best known result from the literature.

[12]  arXiv:2208.04471 (cross-list from eess.SY) [pdf, other]
Title: Parameter Estimation in Ill-conditioned Low-inertia Power Systems
Comments: Submitted to 2022 IEEE North American Power Symposium (NAPS)
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC); Applications (stat.AP)

This paper examines model parameter estimation in dynamic power systems whose governing electro-mechanical equations are ill-conditioned or singular. This ill-conditioning is because of converter-interfaced power systems generators' zero or small inertia contribution. Consequently, the overall system inertia decreases, resulting in low-inertia power systems. We show that the standard state-space model based on least squares or subspace estimators fails to exist for these models. We overcome this challenge by considering a least-squares estimator directly on the coupled swing-equation model but not on its transformed first-order state-space form. We specifically focus on estimating inertia (mechanical and virtual) and damping constants, although our method is general enough for estimating other parameters. Our theoretical analysis highlights the role of network topology on the parameter estimates of an individual generator. For generators with greater connectivity, estimation of the associated parameters is more susceptible to variations in other generator states. Furthermore, we numerically show that estimating the parameters by ignoring their ill-conditioning aspects yields highly unreliable results.

[13]  arXiv:2208.04852 (cross-list from q-bio.BM) [pdf, other]
Title: Graph neural networks for the prediction of molecular structure-property relationships
Subjects: Biomolecules (q-bio.BM); Machine Learning (cs.LG); Optimization and Control (math.OC)

Molecular property prediction is of crucial importance in many disciplines such as drug discovery, molecular biology, or material and process design. The frequently employed quantitative structure-property/activity relationships (QSPRs/QSARs) characterize molecules by descriptors which are then mapped to the properties of interest via a linear or nonlinear model. In contrast, graph neural networks, a novel machine learning method, directly work on the molecular graph, i.e., a graph representation where atoms correspond to nodes and bonds correspond to edges. GNNs allow to learn properties in an end-to-end fashion, thereby avoiding the need for informative descriptors as in QSPRs/QSARs. GNNs have been shown to achieve state-of-the-art prediction performance on various property predictions tasks and represent an active field of research. We describe the fundamentals of GNNs and demonstrate the application of GNNs via two examples for molecular property prediction.

[14]  arXiv:2208.04869 (cross-list from eess.SY) [pdf, other]
Title: Assigning Shadow Prices to Synthetic Inertia and Frequency Response Reserves from Renewable Energy Sources
Comments: IEEE Transactions on Sustainable Energy
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

Modern electricity grids throughout the world, particularly in islands such as Great Britain, face a major problem on the road to decarbonisation: the significantly reduced level of system inertia due to integration of Renewable Energy Sources (RES). Given that most RES such as wind and solar are decoupled from the grid through power electronics converters, they do not naturally contribute to system inertia. However, RES could support grid stability through appropriately controlling the converters, but currently no market incentives exist for RES to provide this support. In this paper we develop a methodology to optimally clear a market of ancillary services for frequency control, while explicitly considering the participation of grid-forming and grid-following inverter-based technologies. We propose a mathematical framework that allows to compute shadow prices for ancillary services offered by a pool of diverse providers: synchronous and synthetic inertia, enhanced frequency response (e.g. from curtailed RES) and traditional primary frequency response (e.g. by thermal generators). Several case studies are run on a simplified Great Britain system, to illustrate the applicability and benefits of this pricing scheme.

[15]  arXiv:2208.04879 (cross-list from eess.SY) [pdf, ps, other]
Title: On the incremental form of dissipativity
Comments: To be presented at MTNS 2022
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)

Following the seminal work of Zames, the input-output theory of the 70s acknowledged that incremental properties (e.g. incremental gain) are the relevant quantities to study in nonlinear feedback system analysis. Yet, non-incremental analysis has dominated the use of dissipativity theory in nonlinear control from the 80s. Results connecting dissipativity theory and incremental analysis are scattered and progress has been limited. This abstract investigates whether this theoretical gap is of fundamental nature and considers new avenues to circumvent it.

[16]  arXiv:2208.04883 (cross-list from cs.RO) [pdf, other]
Title: Neural-Rendezvous: Learning-based Robust Guidance and Control to Encounter Interstellar Objects
Comments: Submitted to AIAA Journal of Guidance, Control, and Dynamics
Subjects: Robotics (cs.RO); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Systems and Control (eess.SY); Optimization and Control (math.OC)

Interstellar objects (ISOs), astronomical objects not gravitationally bound to the Sun, are likely representatives of primitive materials invaluable in understanding exoplanetary star systems. Due to their poorly constrained orbits with generally high inclinations and relative velocities, however, exploring ISOs with conventional human-in-the-loop approaches is significantly challenging. This paper presents Neural-Rendezvous -- a deep learning-based guidance and control framework for encountering any fast-moving objects, including ISOs, robustly, accurately, and autonomously in real-time. It uses pointwise minimum norm tracking control on top of a guidance policy modeled by a spectrally-normalized deep neural network, where its hyperparameters are tuned with a newly introduced loss function directly penalizing the state trajectory tracking error. We rigorously show that, even in the challenging case of ISO exploration, Neural-Rendezvous provides 1) a high probability exponential bound on the expected spacecraft delivery error; and 2) a finite optimality gap with respect to the solution of model predictive control, both of which are indispensable especially for such a critical space mission. In numerical simulations, Neural-Rendezvous is demonstrated to achieve a terminal-time delivery error of less than 0.2 km for 99% of the ISO candidates with realistic state uncertainty, whilst retaining computational efficiency sufficient for real-time implementation.

### Replacements for Wed, 10 Aug 22

[17]  arXiv:2008.01465 (replaced) [pdf, other]
Title: Optimal Path Homotopy For Univariate Polynomials
Authors: Bao Duy Tran
Subjects: Optimization and Control (math.OC)
[18]  arXiv:2102.00092 (replaced) [pdf, other]
Title: Reinforcement Learning for Freight Booking Control Problems
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG)
[19]  arXiv:2107.08566 (replaced) [pdf, ps, other]
Title: Controlled invariant sets: implicit closed-form representations and applications
Comments: 28 pages, 9 figures, 3 tables
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[20]  arXiv:2201.05250 (replaced) [pdf, ps, other]
Title: Consistent Approximations in Composite Optimization
Subjects: Optimization and Control (math.OC); Machine Learning (cs.LG); Machine Learning (stat.ML)
[21]  arXiv:2203.15271 (replaced) [pdf, other]
Title: Approximate Information States for Worst-case Control of Uncertain Systems
Subjects: Optimization and Control (math.OC)
[22]  arXiv:2203.16237 (replaced) [pdf, other]
Title: On the Regret of $\mathcal{H}_{\infty}$ Control
Comments: Accepted to the 2022 IEEE Conference on Decision and Control (CDC)
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
[23]  arXiv:2206.09865 (replaced) [pdf, ps, other]
Title: The exact worst-case convergence rate of the alternating direction method of multipliers
Subjects: Optimization and Control (math.OC)
[24]  arXiv:2207.11425 (replaced) [pdf, other]
Title: A Dual Accelerated Method for Online Stochastic Distributed Averaging: From Consensus to Decentralized Policy Evaluation
Subjects: Optimization and Control (math.OC); Multiagent Systems (cs.MA); Systems and Control (eess.SY)
[25]  arXiv:2207.13570 (replaced) [pdf, ps, other]
Title: Sharpness and non-sharpness of occupation measure bounds for integral variational problems
Comments: 25 pages, fixed titles of references in v2
Subjects: Optimization and Control (math.OC)
[26]  arXiv:2208.00507 (replaced) [pdf, ps, other]
Title: Integral functionals on nonseparable Banach spaces with applications
Subjects: Optimization and Control (math.OC); Functional Analysis (math.FA); Probability (math.PR)
[27]  arXiv:2208.04305 (replaced) [pdf, ps, other]
Title: Numerical Solution of Nonlinear Periodic Optimal Control Problems Using a Fourier Integral Pseudospectral Method
Subjects: Optimization and Control (math.OC)
[28]  arXiv:1905.13246 (replaced) [pdf, other]
Title: Largest Inscribed Rectangles in Geometric Convex Sets
Authors: Mehdi Behroozi
Subjects: Computational Geometry (cs.CG); Metric Geometry (math.MG); Optimization and Control (math.OC)
[29]  arXiv:2105.01637 (replaced) [pdf, other]
Title: Implicit differentiation for fast hyperparameter selection in non-smooth convex learning
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Optimization and Control (math.OC)
[30]  arXiv:2105.09439 (replaced) [pdf, ps, other]
Title: The Simultaneous Assignment Problem
Subjects: Data Structures and Algorithms (cs.DS); Optimization and Control (math.OC)
[31]  arXiv:2107.02004 (replaced) [pdf, other]
Title: Newton-series-based observer-predictor control for disturbed input-delayed discrete-time systems
Comments: V2: Final version accepted to the Automatica journal at August 8, 2022. Modifications were made to the previous version by following the review process
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
[32]  arXiv:2108.03812 (replaced) [pdf, other]
Title: Low-Complexity Algorithm for Restless Bandits with Imperfect Observations
Subjects: Machine Learning (cs.LG); Optimization and Control (math.OC)
[33]  arXiv:2110.04638 (replaced) [pdf, other]
Title: Satisficing Paths and Independent Multi-Agent Reinforcement Learning in Stochastic Games
Subjects: Computer Science and Game Theory (cs.GT); Machine Learning (cs.LG); Optimization and Control (math.OC)
[34]  arXiv:2111.15407 (replaced) [pdf, other]
Title: Monotone one-port circuits
Subjects: Systems and Control (eess.SY); Optimization and Control (math.OC)
[35]  arXiv:2206.12679 (replaced) [pdf, ps, other]
Title: Optimal Regulation of Prosumers and Consumers in Smart Energy Communities
Comments: To appear in the proceedings of 2022 IEEE International Smart Cities Conference (ISC2), September 2022
Subjects: Systems and Control (eess.SY); Multiagent Systems (cs.MA); Optimization and Control (math.OC)
[ total of 35 entries: 1-35 ]
[ showing up to 2000 entries per page: fewer | more ]

Disable MathJax (What is MathJax?)

Links to: arXiv, form interface, find, math, recent, 2208, contact, help  (Access key information)