Information Theory

Authors and titles for September 2021

[201] arXiv:2109.02914 (cross-list from cs.LG) [pdf, other]

Title: Scale-invariant representation of machine learning

Sungyeop Lee, Junghyo Jo

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Data Analysis, Statistics and Probability (physics.data-an)

[202] arXiv:2109.02997 (cross-list from cs.DS) [pdf, other]

Title: Simple Worst-Case Optimal Adaptive Prefix-Free Coding

Travis Gagie

Subjects: Data Structures and Algorithms (cs.DS); Information Theory (cs.IT)

[203] arXiv:2109.03128 (cross-list from eess.SP) [pdf, other]

Title: Learning-Based Downlink Power Allocation in Cell-Free Massive MIMO Systems

Mahmoud Zaher, Özlem Tuğfe Demir, Emil Björnson, Marina Petrova

Comments: 15 pages, To appear in IEEE Transactions on Wireless Communications

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[204] arXiv:2109.03273 (cross-list from eess.SP) [pdf, other]

Title: LuMaMi28: Real-Time Millimeter-Wave Massive MIMO Systems with Antenna Selection

MinKeun Chung, Liang Liu, Andreas Johansson, Sara Gunnarsson, Martin Nilsson, Zhinong Ying, Olof Zander, Kamal Samanta, Chris Clifton, Toshiyuki Koimori, Shinya Morita, Satoshi Taniguchi, Fredrik Tufvesson, Ove Edfors

Comments: 14 pages, 17 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[205] arXiv:2109.03284 (cross-list from physics.app-ph) [pdf, other]

Title: Metasurface-Programmable Wireless Network-on-Chip

Mohammadreza F. Imani, Sergi Abadal, Philipp del Hougne

Comments: 15 pages including 8 figures

Journal-ref: Adv. Sci. TBD, 2201458 (2022)

Subjects: Applied Physics (physics.app-ph); Information Theory (cs.IT); Networking and Internet Architecture (cs.NI); Signal Processing (eess.SP)

[206] arXiv:2109.03780 (cross-list from eess.SP) [pdf, other]

Title: Bayesian Over-The-Air Computation

Yulin Shao, Deniz Gunduz, Soung Chang Liew

Comments: Multi-tier computing, over-the-air computation, Bayesian estimation, sum-product algorithm. 18 pages, 11 figures. arXiv admin note: text overlap with arXiv:2102.13604

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[207] arXiv:2109.03853 (cross-list from cs.CL) [pdf, other]

Title: A Bayesian Framework for Information-Theoretic Probing

Tiago Pimentel, Ryan Cotterell

Comments: Accepted for publication in EMNLP 2021. Code available in this https URL

Subjects: Computation and Language (cs.CL); Information Theory (cs.IT)

[208] arXiv:2109.03943 (cross-list from math.ST) [pdf, other]

Title: Sharp regret bounds for empirical Bayes and compound decision problems

Yury Polyanskiy, Yihong Wu

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT); Machine Learning (stat.ML)

[209] arXiv:2109.03946 (cross-list from math.PR) [pdf, other]

Title: Quantitative form of Ball's Cube slicing in $\mathbb{R}^n$ and equality cases in the min-entropy power inequality

James Melbourne, Cyril Roberto

Comments: 14 pages

Subjects: Probability (math.PR); Information Theory (cs.IT); Functional Analysis (math.FA)

[210] arXiv:2109.04192 (cross-list from eess.SP) [pdf, other]

Title: Detection of Abrupt Change in Channel Covariance Matrix for Multi-Antenna Communication

Runnan Liu, Liang Liu, Dazhi He, Wenjun Zhang, Erik G. Larsson

Comments: accepted by Globecom 2021

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[211] arXiv:2109.04346 (cross-list from math.ST) [pdf, other]

Title: Goodness-of-Fit Testing for H\"older-Continuous Densities: Sharp Local Minimax Rates

Julien Chhor, Alexandra Carpentier

Comments: 79 pages

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[212] arXiv:2109.04441 (cross-list from math.FA) [pdf, other]

Title: Exponential bases for partitions of intervals

Goetz Pfander, Shauna Revay, David Walnut

Subjects: Functional Analysis (math.FA); Information Theory (cs.IT)

[213] arXiv:2109.04649 (cross-list from cs.CR) [pdf, other]

Title: Utilizing Shannon's Entropy to Create Privacy Aware Architectures

Abhinav Palia, Rajat Tandon, Carl Mathis

Comments: 8 pages, 1 figure

Subjects: Cryptography and Security (cs.CR); Databases (cs.DB); Information Theory (cs.IT)

[214] arXiv:2109.04784 (cross-list from cs.NI) [pdf, other]

Title: Scheduling Policies for AoI Minimization with Timely Throughput Constraints

Emmanouil Fountoulakis, Themistoklis Charalambous, Anthony Ephremides, Nikolaos Pappas

Comments: Accepted in IEEE TCOM

Subjects: Networking and Internet Architecture (cs.NI); Information Theory (cs.IT)

[215] arXiv:2109.04839 (cross-list from math.DG) [pdf, other]

Title: Kahler toric manifolds from dually flat spaces

Mathieu Molitor

Subjects: Differential Geometry (math.DG); Information Theory (cs.IT); Mathematical Physics (math-ph); Symplectic Geometry (math.SG)

[216] arXiv:2109.05136 (cross-list from quant-ph) [pdf, other]

Title: Efficient Noise Mitigation Technique for Quantum Computing

Ali Shaib, Mohamad H. Naim, Mohammed E. Fouda, Rouwaida Kanj, Fadi Kurdahi

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Signal Processing (eess.SP)

[217] arXiv:2109.05344 (cross-list from cs.DL) [pdf, other]

Title: Viewing citation trend of Indian physics and astronomy research papers since 2005 through the lens of some new indicators

Gopinath Das, Bidyarthi Dutta, Anup Kumar Das

Comments: 9 pages, 3 figures

Subjects: Digital Libraries (cs.DL); Information Theory (cs.IT)

[218] arXiv:2109.05378 (cross-list from q-bio.PE) [pdf, other]

Title: Modelling the Utility of Group Testing for Public Health Surveillance

Günther Koliander, Georg Pichler

Comments: 27 pages, 3 figures

Journal-ref: Infectious Disease Modelling, vol. 6, 2021, p. 1009-1024

Subjects: Populations and Evolution (q-bio.PE); Information Theory (cs.IT)

[219] arXiv:2109.05402 (cross-list from stat.ML) [pdf, other]

Title: Differentially Private Variable Selection via the Knockoff Filter

Mehrdad Pournaderi, Yu Xiang

Comments: Accepted to the 2021 IEEE International Workshop on Machine Learning for Signal Processing (MLSP)

Subjects: Machine Learning (stat.ML); Cryptography and Security (cs.CR); Databases (cs.DB); Information Theory (cs.IT); Machine Learning (cs.LG)

[220] arXiv:2109.05466 (cross-list from eess.SP) [pdf, other]

Title: Graph Attention Network Based Single-Pixel Compressive Direction of Arrival Estimation

Kürşat Tekbıyık, Okan Yurduseven, Güneş Karabulut Kurt

Comments: 5 pages, 4 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Machine Learning (cs.LG)

[221] arXiv:2109.05547 (cross-list from quant-ph) [pdf, other]

Title: Towards a variational Jordan-Lee-Preskill quantum algorithm

Junyu Liu, Zimu Li, Han Zheng, Xiao Yuan, Jinzhao Sun

Comments: v2: modified style, add references, clear typos. v3; v4: significant change, authors added

Journal-ref: Mach. Learn.: Sci. Technol. 3 045030, 2022

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT); Machine Learning (cs.LG); High Energy Physics - Theory (hep-th)

[222] arXiv:2109.05681 (cross-list from eess.SP) [pdf, other]

Title: Multi-User Scheduling in Hybrid Millimeter Wave Massive MIMO Systems

Seyedeh Maryam Hosseini, Shahram Shahsavari, Catherine Rosenberg

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[223] arXiv:2109.06141 (cross-list from cs.LG) [pdf, other]

Title: On Tilted Losses in Machine Learning: Theory and Applications

Tian Li, Ahmad Beirami, Maziar Sanjabi, Virginia Smith

Comments: arXiv admin note: substantial text overlap with arXiv:2007.01162

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Optimization and Control (math.OC); Machine Learning (stat.ML)

[224] arXiv:2109.06232 (cross-list from cs.CL) [pdf, other]

Title: The Emergence of the Shape Bias Results from Communicative Efficiency

Eva Portelance, Michael C. Frank, Dan Jurafsky, Alessandro Sordoni, Romain Laroche

Comments: Accepted at CoNLL 2021

Subjects: Computation and Language (cs.CL); Information Theory (cs.IT); Neural and Evolutionary Computing (cs.NE)

[225] arXiv:2109.06248 (cross-list from quant-ph) [pdf, other]

Title: Distilling GHZ States using Stabilizer Codes

Narayanan Rengaswamy, Ankur Raina, Nithin Raveendran, Bane Vasić

Comments: Main paper: 19 pages, single column, IEEEtran class, 3 figures, 2 tables (protocol examples), 3 pseudo-codes. Implementation online: this https URL. Comments welcome!

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[226] arXiv:2109.06344 (cross-list from eess.SP) [pdf, other]

Title: On the Correlation between the Noise and a Priori Error Vectors in Affine Projection Algorithms

Andres Altieri

Comments: 23 pages, 7 figures. Submitted for possible publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[227] arXiv:2109.06709 (cross-list from quant-ph) [pdf, other]

Title: QKD parameter estimation by two-universal hashing

Dimiter Ostrev

Journal-ref: Quantum 7, 894 (2023)

Subjects: Quantum Physics (quant-ph); Cryptography and Security (cs.CR); Information Theory (cs.IT)

[228] arXiv:2109.07189 (cross-list from cs.DM) [pdf, other]

Title: On Characterization of Finite Geometric Distributive Lattices

Pranab Basu

Comments: Major corrections included. Abstract and few definitions are modified, some proofs are rectified. A new section added to the previous version. 13 pages, 3 figures, submitted to Journal of Combinatorial Theory, Series A

Subjects: Discrete Mathematics (cs.DM); Information Theory (cs.IT); Combinatorics (math.CO)

[229] arXiv:2109.07727 (cross-list from eess.SP) [pdf, other]

Title: Secure Transmission for Hierarchical Information Accessibility in Downlink MU-MIMO

Kanguk Lee, Jinseok Choi, Dong Ku Kim, Jeonghun Park

Comments: submitted for possible IEEE journal publication

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[230] arXiv:2109.07763 (cross-list from eess.SP) [pdf, other]

Title: Design and Evaluation of Reconfigurable Intelligent Surfaces in Real-World Environment

Georgios C. Trichopoulos, Panagiotis Theofanopoulos, Bharath Kashyap, Aditya Shekhawat, Anuj Modi, Tawfik Osman, Sanjay Kumar, Anand Sengar, Arkajyoti Chang, Ahmed Alkhateeb

Comments: Submitted to IEEE Open Journal of the Communications Society, 29 pages, 20 figures

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[231] arXiv:2109.07933 (cross-list from q-bio.BM) [pdf, other]

Title: Emergence of functional information from multivariate correlations

Christoph Adami, Nitash C G (Michigan State University)

Comments: 20 pages, 5 figures

Journal-ref: Phil. Trans. Roy. Society A 380 (2022) 20210250

Subjects: Biomolecules (q-bio.BM); Information Theory (cs.IT); Biological Physics (physics.bio-ph); Populations and Evolution (q-bio.PE)

[232] arXiv:2109.08170 (cross-list from quant-ph) [pdf, other]

Title: Quantum message-passing algorithm for optimal and efficient decoding

Christophe Piveteau, Joseph M. Renes

Comments: 56 pages, 22 figures, submitted to Quantum

Journal-ref: Quantum 6, 784 (2022)

Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)

[233] arXiv:2109.08378 (cross-list from eess.SP) [pdf, other]

Title: Maximum-Rate Optimization of Hybrid Intelligent Reflective Surface and Relay Systems

Alberto Rech, Federico Moretto, Stefano Tomasin

Comments: 5 pages, conference paper (SPAWC21)

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[234] arXiv:2109.08523 (cross-list from cs.OH) [pdf, other]

Title: A Computable Piece of Uncomputable Art whose Expansion May Explain the Universe in Software Space

Hector Zenil

Comments: 20 pages. Invited contribution. arXiv admin note: substantial text overlap with arXiv:1904.10258, arXiv:1401.3613

Subjects: Other Computer Science (cs.OH); Artificial Intelligence (cs.AI); Information Theory (cs.IT)

[235] arXiv:2109.08589 (cross-list from cs.CY) [pdf, other]

Title: Event Flow -- How Events Shaped the Flow of the News, 1950-1995

Melvin Wevers, Jan Kostkan, Kristoffer L. Nielbo

Comments: 12 pages, 8 figures, conference: Computational Humanities Research Conference 2021

Subjects: Computers and Society (cs.CY); Information Retrieval (cs.IR); Information Theory (cs.IT)

[236] arXiv:2109.08813 (cross-list from physics.geo-ph) [pdf, other]

Title: Data-driven rational function neural networks: a new method for generating analytical models of rock physics

Weitao Sun

Comments: 16 pages, 4 figures

Subjects: Geophysics (physics.geo-ph); Information Theory (cs.IT)

[237] arXiv:2109.08933 (cross-list from cs.DC) [pdf, other]

Title: Optimization-based Block Coordinate Gradient Coding

Qi Wang, Ying Cui, Chenglin Li, Junni Zou, Hongkai Xiong

Comments: 6 pages, ,4 figures, to appear in Proc. of IEEE GLOBECOM, 2021

Subjects: Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[238] arXiv:2109.08967 (cross-list from cs.LG) [pdf, other]

Title: Ensemble Learning using Error Correcting Output Codes: New Classification Error Bounds

Hieu D. Nguyen, Mohammed Sarosh Khan, Nicholas Kaegi, Shen-Shyang Ho, Jonathan Moore, Logan Borys, Lucas Lavalva

Comments: 14 pages, 11 figures

Subjects: Machine Learning (cs.LG); Information Theory (cs.IT)

[239] arXiv:2109.09028 (cross-list from math.ST) [pdf, other]

Title: Sharp Concentration Inequalities for the Centered Relative Entropy

Alankrita Bhatt, Ankit Pensia

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[240] arXiv:2109.09068 (cross-list from eess.SP) [pdf, other]

Title: Channel Estimation in MIMO Systems with One-bit Spatial Sigma-delta ADCs

R.S. Prasobh Sankar, Sundeep Prabhakar Chepuri

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT)

[241] arXiv:2109.09682 (cross-list from eess.SP) [pdf, other]

Title: Convolution and Correlation Theorems for Wigner-Ville Distribution Associated with the Quaternion Offset Linear Canonical Transform

Mohammad Younus Bhat, Aamir Hamid Dar

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Functional Analysis (math.FA)

[242] arXiv:2109.09683 (cross-list from eess.SP) [pdf, other]

Title: Single-ended Coherent Receiver

Son Thai Le, Vahid Aref, Junho Cho

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Optics (physics.optics)

[243] arXiv:2109.09709 (cross-list from cond-mat.stat-mech) [pdf, other]

Title: Information dynamics and the arrow of time

Aram Ebtekar

Comments: 64 pages, LaTeX; substantial revision with clearer exposition

Subjects: Statistical Mechanics (cond-mat.stat-mech); Formal Languages and Automata Theory (cs.FL); Information Theory (cs.IT); Cellular Automata and Lattice Gases (nlin.CG)

[244] arXiv:2109.09868 (cross-list from cs.LG) [pdf, other]

Title: ApproxIFER: A Model-Agnostic Approach to Resilient and Robust Prediction Serving Systems

Mahdi Soleymani, Ramy E. Ali, Hessam Mahdavifar, A. Salman Avestimehr

Subjects: Machine Learning (cs.LG); Distributed, Parallel, and Cluster Computing (cs.DC); Information Theory (cs.IT)

[245] arXiv:2109.10040 (cross-list from eess.SP) [pdf, other]

Title: Nyquist-Sampling and Degrees of Freedom of Electromagnetic Fields

Andrea Pizzo, Andrea de Jesus Torres, Luca Sanguinetti, Thomas L. Marzetta

Comments: IEEE Transactions on Signal Processing

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Optics (physics.optics)

[246] arXiv:2109.10319 (cross-list from stat.ML) [pdf, other]

Title: Community detection for weighted bipartite networks

Huan Qing, Jingli Wang

Comments: 27pages

Journal-ref: Knowledge-Based Systems (2023)

Subjects: Machine Learning (stat.ML); Information Theory (cs.IT); Machine Learning (cs.LG)

[247] arXiv:2109.10431 (cross-list from cs.LG) [pdf, other]

Title: Fairness without Imputation: A Decision Tree Approach for Fair Prediction with Missing Values

Haewon Jeong, Hao Wang, Flavio P. Calmon

Subjects: Machine Learning (cs.LG); Computers and Society (cs.CY); Information Theory (cs.IT); Machine Learning (stat.ML)

[248] arXiv:2109.10481 (cross-list from math.ST) [pdf, other]

Title: Sparse Uniformity Testing

Bhaswar B. Bhattacharya, Rajarshi Mukherjee

Comments: 33 pages, 1 figure

Subjects: Statistics Theory (math.ST); Information Theory (cs.IT)

[249] arXiv:2109.10505 (cross-list from eess.SP) [pdf, other]

Title: Sensor-Based Satellite IoT for Early Wildfire Detection

How-Hang Liu, Ronald Y. Chang, Yi-Ying Chen, I-Kang Fu

Comments: To appear in IEEE GLOBECOM 2021 Workshops

Subjects: Signal Processing (eess.SP); Information Theory (cs.IT); Systems and Control (eess.SY)

[250] arXiv:2109.10528 (cross-list from cs.CR) [pdf, other]

Title: A unified interpretation of the Gaussian mechanism for differential privacy through the sensitivity index

Georgios Kaissis, Moritz Knolle, Friederike Jungmann, Alexander Ziller, Dmitrii Usynin, Daniel Rueckert

Comments: Under review at PETS 2022

Subjects: Cryptography and Security (cs.CR); Information Theory (cs.IT); Machine Learning (cs.LG)