FULL [LIST] OF PUBLICATIONS
SELECTED PUBLICATIONS & PREPRINTS:
PREPRINTS
●
I. Papageorgiou and I.
Kontoyiannis. "The Bayesian Context Trees State Space Model for time
series modelling and forecasting." Submitted. [arXiv]
●
A. Theocharous, G.G.
Gregoriou, P. Sapountzis, and I. Kontoyiannis.
"Temporally causal discovery tests for discrete time series and neural
spike trains." Submitted. [arXiv]
●
M. Berta, L. Gavalakis and I.
Kontoyiannis. "A third information-theoretic approach to finite de Finetti
theorems." Sumbitted. [arXiv]
●
E.M. Loizidou,
P. Barbounakis, S. Glentis,
A. Dimopoulos, M. Anezaki, P. Rouskas,
I. Kontoyiannis, N. Demiris, K. Rouskas, A.S. Dimas.
"Periodic veganism in healthy individuals improves blood lipids, reduces
low-grade inflammation, but impairs bone health: The FastBio
study." Submitted. [medRxiv]
●
V. Lungu, I. Papageorgiou and
I. Kontoyiannis. "Change-point detection and segmentation of discrete data
using Bayesian Context Trees. " Submitted. [arXiv] Associated R package on CRAN [BCT]
●
V. Borkar, S. Chen, A. Devraj,
I. Kontoyiannis and S.P. Meyn. "The ODE method for asymptotic statistics
in stochastic approximation and reinforcement learning." Submitted. [arXiv]
2021-PRESENT
●
L. Gavalakis and I.
Kontoyiannis. "Entropy and the discrete central limit theorem." To
appear, Stochastic Processes and Their Applications, 2024. [arXiv]
●
I. Kontoyiannis.
"Context-tree weighting and Bayesian Context Trees: Asymptotic and
non-asymptotic justifications." To appear, IEEE Trans. Information
Theory, 2024. [arXiv]
●
I. Papageorgiou and I.
Kontoyiannis. "Posterior representations for Bayesian Context Trees:
Sampling, estimation and convergence." To appear, Bayesian Analysis,
2024. [arXiv]
●
M. Tapia Costa, I.
Kontoyiannis and S Godsill. "Generalised shot noise representations of
stochastic systems driven by non-Gaussian Lévy processes." To
appear, Journal of Applied Probability, 2024. [arXiv]
●
I. Papageorgiou and I.
Kontoyiannis. "Context-tree weighting for real-valued time series: Bayesian
inference with hierarchical mixture models." 2023 IEEE International
Symposium on Information Theory, Taipei, Taiwan, June 2023. [arXiv]
●
I. Gavalakis and I.
Kontoyiannis. "Information in probability: Another information-theoretic
proof of a finite de Finetti theorem." In Mathematics Going Forward:
Collected Mathematical Brushstrokes, (J.-M. Morel, B. Teissier, editors),
pp. 367-385, Lecture Notes in Mathematics series, vol. 2313, Springer,
Switzerland, May 2023. [arXiv]
●
I. Papageorgiou and I.
Kontoyiannis. "Truly Bayesian entropy estimation." 2023 IEEE
Information Theory Workshop,
●
I. Kontoyiannis, L. Mertzanis, A. Panotopoulou, I. Papageorgiou and M. Skoularidou.
"Bayesian Context Trees: Modelling and exact inference for discrete time
series." Journal of the Royal
Statistical Society: Series B, 84, no. 4, pp. 1287-1323, September
2022. [arXiv] Associated R package on CRAN [BCT]
●
L. Tray and I. Kontoyiannis.
"The feature-first block model." 36th International Workshop on
Statistical Modelling, Trieste, Italy July 2022. Longer version: [arXiv]
●
I. Kontoyiannis, Y.H. Lim, K. Papakonstantinopoulou and W. Szpankowski.
"Compression and symmetry of small-world graphs and structures." Communications
in Information and Systems, 22, no. 2, pp. 275-302, May
2022. [arXiv]
●
I. Papageorgiou, V.M. Lungu
and I. Kontoyiannis. R package BCT: "Bayesian Context Trees for Discrete Time Series." Version
1.2, May 2022, available on CRAN [BCT]
●
P. Barmpounakis, N. Demiris,
I. Kontoyiannis, G. Pavlakis and V. Sypsa. " Evaluating the effects of
second-dose vaccine-delay policies in European countries: A simulation study
based on data from Greece." PLoS ONE, 17(4): e0263977, April 2022.
[medRxiv]
●
L. Gavalakis and I.
Kontoyiannis. "An information-theoretic proof
of a finite de Finetti theorem." Electronic Comm. in Probab., 26, paper 68, pp. 1-5, December 2021. [arXiv]
●
T.B. Berrett, I. Kontoyiannis
and R.J. Samworth. "Optimal rates for
independence testing via U-statistic
permutation tests." Annals of Statistics, 49, no. 5, pp.
2457-2490, October 2021. [arXiv] Associated R package on CRAN [USP]
●
A.M. Devraj, I. Kontoyiannis
and S.P. Meyn. "Differential temporal
difference learning." To IEEE Trans. Automatic Control, 66,
no. 10, pp. 4652-4667 October 2021. [arXiv]
●
S. Diggavi, A. El Gamal, I.
Kontoyiannis, A. Paranjpe and M. Subbarao "Joy Thomas: Legacy, foundation
and the IT society." IEEE BITS the Information Theory Magazine, 1,
no. 1, pp. 85-88, August 2021. [IEEEXplore] [pdf]
●
L. Gavalakis and I.
Kontoyiannis. "Fundamental limits of lossless data compression with side
information." IEEE Trans. Information Theory, 67, no. 5, pp.
2680-2692, May 2021. [arXiv]
●
J. Taipale, I. Kontoyiannis
and S. Linnarsson. "Population-scale testing can suppress the spread of
infectious disease." arXiv manuscript,
2104.06857 [q-bio.PE], April 2021. [arXiv] Conference talk on YouTube [video] [slides]
2016-2020
●
I. Papageorgiou, V.M. Lungu
and I. Kontoyiannis. R package BCT: "Bayesian Context Trees for Discrete Time Series." Version
1.1, November 2020, available on CRAN [BCT]
●
T.B. Berrett, I. Kontoyiannis
and R.J. Samworth. R package USP: "U-Statistic Permutation Tests of Independence for all Data
Types." Version 1.0, November 2020, available on CRAN [USP]
●
R. Cavallari, S. Toumpis, R. Verdone and I. Kontoyiannis. "Packet speed
and cost in mobile wireless delay-tolerant networks." IEEE Trans.
Information Theory, 66, no. 9, pp. 5683-5702, September 2020. [arXiv]
●
M. Riabiz,
T. Ardeshiri, I. Kontoyiannis and S Godsill. "Nonasymptotic Gaussian approximation for inference with
stable noise." IEEE Trans. Information Theory, 66, no. 8,
pp. 4966-4991, August 2020. [arXiv]
●
D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "A simple network of nodes moving on the
circle." Random Structures & Algorithms, 57, no. 2, pp.
317-338, July 2020. [arXiv]
●
L. Gavalakis and I.
Kontoyiannis. "Sharp second-order pointwise asymptotics for lossless
compression with side information." Entropy, 22,
no. 6, paper 705, June 2020. [arXiv]
●
A.M. Devraj, I. Kontoyiannis
and S.P. Meyn. "Geometric ergodicity in a weighted Sobolev space." Annals of Probability, 48,
no. 1, pp. 308-403, January 2020. [arXiv]
●
M. Madiman and I.
Kontoyiannis. "Entropy bounds on abelian groups and the Ruzsa
divergence." IEEE Trans. Information Theory, 64, no. 1, pp. 77-92, January 2018. [arXiv]
●
M. Riabiz,
T. Ardeshiri, I. Kontoyiannis and S Godsill.
"Simulated convergence rates with application to an intractable
alpha-stable inference problem." (invited paper) IEEE
International Workshop on Computational Advances in Multi-Sensor Adaptive
Processing,
Curaçao, Dutch Antilles, December 2017. [pdf]
●
I. Kontoyiannis and S.P. Meyn.
"Approximating a diffusion by a finite-state hidden Markov model." Stochastic
Processes and their Applications, 127, no. 8, pp. 2482-2507, August 2017. [pdf] [arXiv]
●
D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "Exact speed and transmission cost in a
simple one-dimensional wireless delay-tolerant network." 2017 IEEE
International Symposium on Information Theory, Aachen, Germany, June 2017.
[pdf]
●
I. Kontoyiannis and S.P. Meyn.
"On the f-norm ergodicity of Markov processes in continuous
time." Electronic
Comm. in Probab., 21, paper 77, pp. 1-10, November
2016. [pdf] [arXiv]
● I. Kontoyiannis and M. Skoularidou.
"Estimating the directed information and testing for
causality." IEEE Trans. Information Theory, 62, no.
11, pp. 6053-6067,
November 2016. [arXiv]
●
Book: (in Greek) I. Kontoyiannis and S. Toumpis.
"Elements of
Probability: With Applications in Statistics and Computer Science."
Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation in Greek: Γ. Κοντογιάννης και Σ. Τουμπής. "Στοιχεία
πιθανοτήτων:
Με εφαρμογές
στη στατιστική
και την
πληροφορική". Σύνδεσμος
Ελληνικών
Ακαδημαϊκών
Βιβλιοθηκών, Αθήνα,
2015.] ISBN: 978-960-603-182-3 [Official
Page] [Latest
Version] [Searchable pdf without hyperlinks]
●
I. Kontoyiannis and M.
Madiman. "Sumset and inverse sumset
inequalities for differential entropy and mutual information." IEEE
Trans. Information Theory, 60, no. 8, pp. 4503-4514, August 2014. [pdf]
●
I. Kontoyiannis and S.
Verdú. "Optimal lossless data compression: Non-asymptotics and
asymptotics." IEEE Trans. Information Theory, 60, no. 2, pp.
777-795, February 2014. [pdf]
●
Y. Altuğ, I. Kontoyiannis
and A.B. Wagner. "Lossless compression with moderate error
probability." 2013 IEEE International Symposium on Information Theory,
Istanbul, Turkey, July 2013. [pdf]
●
O. Johnson, I. Kontoyiannis
and M. Madiman. "Log-concavity, ultra-log-concavity and a maximum entropy
property of discrete compound Poisson measures." Discrete Applied Mathematics (Special issue, Proceedings of the
Jubilee Conference on Discrete Mathematics JCDM 2009, D. J. Kleitman,
A. Shastri, V. T. So's, eds.) 161, no. 9, pp. 1232-1250, June 2013. [pdf] See also
earlier version on the [arXiv]
●
C. Gioran
and I. Kontoyiannis. "Complexity-compression tradeoffs
in lossy compression via efficient random codebooks and databases." Problems of Information Transmission, 48,
Issue 4, pp. 376-394, October 2012. [pdf]
●
I. Kontoyiannis and S.P. Meyn.
"Geometric ergodicity and the spectral gap of non-reversible Markov
chains." Probability
Theory and Related Fields, 154,
Issue 1-2, pp. 327-339, October 2012. [pdf]
●
V. Anantharam,
G. Caire, M. Costa, I. Kontoyiannis, G. Kramer, R. Yeung, and S. Verdú.
"Panel on New Perspectives on
Information Theory." (Invited discussion.) IEEE Information Theory Society Newsletter, pp. 21-27, March 2012.
[pdf]
●
P. Dellaportas
and I. Kontoyiannis. "Control variates for estimation based on reversible
Markov chain Monte Carlo samplers." Journal
of the Royal Statistical Society: Series B, 74, Part 1, pp. 133-161, 2012. [pdf]
●
P. Harremoës,
O. Johnson and I. Kontoyiannis. "Thinning, entropy and the law of thin
numbers." IEEE Trans. Inform. Theory, 56, no. 9, pp. 4228-4244, September 2010. [pdf]
●
A.D. Barbour, O. Johnson, I.
Kontoyiannis and M. Madiman. "Compound Poisson approximation via
information functionals." Electronic J. of Probab.,
15, paper 42, pp. 1344-1368, August
2010. [pdf]
●
A. Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I.
Kontoyiannis and E. Upfal. "Probabilistic
analysis of the k-server problem on
the circle." Unpublishe manuscript, May 2010. [pdf]
●
P. Dellaportas
and I. Kontoyiannis. "Notes on using control variates for estimation with
reversible MCMC samplers." arXiv manuscript, 0907.4160 [stat.CO], July 2009. [arXiv]
2006-2008
●
S. Kyriazopoulou-Panagiotopoulou,
I. Kontoyiannis and S.P. Meyn. "Control variates as screening functions.
" Third International Conference on Performance Evaluation
Methodologies and Tools, Athens, Greece, October 2008. [pdf]
●
M. Harrison and I.
Kontoyiannis "Estimation of the rate-distortion function." IEEE
Trans. Inform. Theory, 54, pp. 3757-3763, August 2008. [pdf] See also the
longer version with additional results, details and proofs on the [arXiv]
●
I. Kontoyiannis. "Book
review: "Information and complexity in statistical modeling,"
by J. Rissanen, Springer, NY, 2007." Amer. Math. Monthly, 115,
no. 10, pp. 956-960, December 2008. [pdf] [pdf]
●
I. Kontoyiannis and S.P. Meyn.
"Computable exponential bounds for screened estimation and
simulation." Ann. Appl. Probab., 18,
pp. 1491-1518, August 2008. [pdf]
●
Y. Gao, I. Kontoyiannis and E.
Bienenstock. "Estimating the entropy of binary time series: Methodology,
some theory and a simulation study." Entropy, 10, issue 2, pp. 71-99,
June 2008. [pdf] [pdf]
●
I. Kontoyiannis. "Counting the primes using entropy." IEEE
Information Theory Society Newsletter, 58, no. 2, pp. 6-9, June
2008. [pdf] [pdf] Slides from a talk on this work at ITW 2008 in
Porto, May 2008. [pdf]
●
I. Kontoyiannis. "Some
information-theoretic computations related to the distribution of prime
numbers." In Festschrift in Honor of Jorma Rissanen, (P. Grunwald,
P. Myllymaki, I. Tabus, M. Weinberger, B. Yu, eds.),
pp. 135-143,
●
H.M. Aktulga,
I. Kontoyiannis,
●
P. Harremoës,
O. Johnson and I. Kontoyiannis. "Thinning and the law of small
numbers." 2007 IEEE International Symposium on Information Theory,
Nice, France, June 2007. [pdf]
●
M. Madiman, O. Johnson and I.
Kontoyiannis. "Fisher information, compound Poisson approximation, and the
Poisson channel." 2007 IEEE International Symposium on Information
Theory, Nice, France, June 2007. [pdf]
●
I. Kontoyiannis,
●
Y. Gao, I. Kontoyiannis and E.
Bienenstock. "From the entropy to the statistical structure of spike
trains." 2006 IEEE International Symposium on Information Theory,
●
I. Kontoyiannis and M.
Madiman. "Measure concentration for compound Poisson distributions." Electronic
Comm. in Probab., 11, paper 5, pp. 45-57,
May 2006. [pdf]
●
I. Kontoyiannis and R. Zamir.
"Mismatched codebooks and the role of entropy-coding in lossy data
compression." IEEE Trans. Inform. Theory, 52, pp. 1922-1938,
May 2006. [pdf] [pdf]
2003-2005
●
I. Kontoyiannis,
●
I. Kontoyiannis and B. Lucena.
"Mutual information, synergy, and some curious phenomena for simple
channels." 2005 IEEE International Symposium on Information Theory,
●
B. Lucena and I. Kontoyiannis.
"Filtering: The case for "noisier" data." 2005 IEEE
Information Theory Workshop,
●
A. Anagnostopoulos, I.
Kontoyiannis and E. Upfal. "Steady state
analysis of balanced allocation routing." Random Structures &
Algorithms, 26, pp. 446-467, July 2005. [pdf]
●
I. Kontoyiannis and S.P. Meyn.
"Large deviations asymptotics and the spectral theory of multiplicatively
regular Markov processes." Electronic J. of Probab.,
10, paper 3, pp. 61-123, February 2005. [pdf]
See also the slides from a presentation on this work: [pdf]
●
I. Kontoyiannis, P. Harremoës and O. Johnson. "Entropy and the law of
small numbers." IEEE Trans. Inform. Theory, 51, pp. 466-472,
February 2005. [pdf] [pdf]
●
I. Kontoyiannis and M.
Madiman. "Entropy, compound Poisson approximation, log-Sobolev
inequalities and measure concentration." 2004 IEEE Information Theory
Workshop,
●
M. Madiman, M. Harrison and I.
Kontoyiannis. "Minimum Description Length vs. Maximum Likelihood in lossy
data compression." 2004 IEEE International Symposium on Information
Theory,
●
Y. Gao, I. Kontoyiannis and E.
Bienenstock. "Estimating the entropy rate of spike trains." 38th
Annual Conference on Information Sciences and Systems,
●
Y. Gao, I. Kontoyiannis and E.
Bienenstock. "Lempel-Ziv and CTW entropy estimators for spike
trains." Invited paper, Estimation of entropy Workshop, 2003 Neural
Information Processing Systems Conference, Vancouver, BC, Canada, December
2003. [pdf]
●
I. Kontoyiannis. "Pattern
matching and lossy data compression on random fields." IEEE Trans.
Inform. Theory, 49, pp. 1047-1051, April 2003. [pdf]
●
I. Kontoyiannis and A.D.
Sezer. "A remark on unified error exponents: Hypothesis testing, data
compression and measure concentration." Barcelona Conference on
Stochastic Inequalities and Their Applications, Spain, 2002; published in Progress
in Probability, vol. 56, pp. 23-32, Birkhauser,
Basel/Switzerland, 2003. [pdf]
●
N. Merhav
and I. Kontoyiannis. "Source coding exponents for zero-delay coding with
finite memory." IEEE Trans. Inform. Theory, 49, pp. 609-625,
March 2003. [pdf]
●
I. Kontoyiannis and S.P. Meyn.
"Spectral theory and limit theorems for geometrically ergodic Markov
processes." Ann. Appl. Probab., 13,
pp. 304-362, February 2003. [pdf]
2000-2002
●
M. Harrison and I.
Kontoyiannis. "Maximum likelihood estimation for lossy data
compression" (invited paper). 40th Allerton Conference on
Communication, Control and Computing,
●
V. Castelli and I.
Kontoyiannis. "An efficient recursive partitioning algorithm for
classification, using wavelets." APPTS
Report
#02-7, Division of Applied Math,
●
J. Huang, I. Kontoyiannis and
S.P. Meyn. "The ODE method and spectral theory of Markov operators."
In Proceedings of Stochastic Theory and Control Workshop, Springer,
●
I. Kontoyiannis and J. Zhang.
"Arbitrary source models and Bayesian codebooks in rate-distortion
theory." IEEE Trans. Inform. Theory, 48, pp. 2276-2290,
August 2002. [pdf]
●
A. Dembo and I. Kontoyiannis.
"Source coding, large deviations, and approximate pattern matching."
Invited paper in IEEE Trans. Inform. Theory special issue on Shannon
theory, dedicated to Aaron D.
Wyner, 48, pp. 1590-1615, June 2002. [pdf]
●
A. Antos and I. Kontoyiannis.
"Convergence properties of functional estimates for discrete
distributions." Random Structures & Algorithms, 19, pp.
163-193. October 2001. [pdf]
●
J. Zhang, E.K.P. Chong and I. Kontoyiannis. "Unified spatial diversity
combining and power allocation schemes for CDMA systems." IEEE J. on
Selected Areas in Comm., 19, pp. 1276-1288, July 2001. [pdf]
●
I. Kontoyiannis.
"Sphere-covering, measure concentration, and source coding." IEEE
Trans. Inform. Theory, 47, pp. 1544-1552, May 2001. [pdf] [pdf]
●
A. Dembo and I. Kontoyiannis.
"Critical behavior in lossy source coding."
IEEE Trans. Inform. Theory, 47, pp. 1230-1236, March 2001. [pdf] [pdf]
●
Patent: "Multiresolution
lossless/lossy compression and storage of data for efficient processing
thereof." With V. Castelli, J. Robinson and J.J. Turek. U.S. Patent No.
6,141,445. October 2000. [HTML]
●
I. Kontoyiannis. "Model
selection via rate-distortion theory" (invited paper). 34th Annual
Conference on Information Sciences and Systems, March 2000. [pdf]
●
Patent: "Multiresolution
lossless/lossy compression and storage of data for efficient processing
thereof." With V. Castelli, J. Robinson and J.J. Turek. U.S. Patent No.
6,021,224. February 2000. [HTML]
●
I. Kontoyiannis.
"Pointwise redundancy in lossy data compression and universal lossy data
compression." IEEE Trans. Inform. Theory, 46, pp. 136-152,
January 2000. [pdf]
1999 & EARLIER
●
I. Kontoyiannis. "An
implementable lossy version of the Lempel-Ziv algorithm -- Part I: Optimality
for memoryless sources." IEEE Trans. Inform. Theory, 45, pp.
2293-2305, November 1999. [pdf]
●
A. Dembo and I. Kontoyiannis.
"Critical behavior in data compression."
Technical Report no. TR-99-26, Department of Statistics,
●
I. Kontoyiannis.
"Efficient sphere-covering and converse measure concentration via
generalized coding theorems." Technical Report no. TR-99-26, Department of
Statistics,
●
A. Dembo and I. Kontoyiannis.
"The asymptotics of waiting times between stationary processes, allowing
distortion." Ann. Appl. Probab., 9,
pp. 413-429, May 1999. [pdf]
●
I. Kontoyiannis.
"Asymptotic recurrence and waiting times for stationary processes." J.
Theoret. Probab., 11, pp. 795-811, July
1998. [pdf]
●
I. Kontoyiannis, P.H. Algoet, Yu. M. Suhov and A.J.
Wyner. "Nonparametric entropy estimation for stationary processes and
random fields, with applications to English text." IEEE Trans. Inform.
Theory, 44, pp. 1319-1327, May 1998. [pdf]
●
Ph.D. Thesis: "Recurrence and Waiting Times in Stationary Processes, and their
Applications in Data Compression." Department
of Electrical Engineering, Stanford
University, May 1998. [HTML]
●
V. Castelli, L. Bergman, I.
Kontoyiannis, C.-S. Li, J. Robinson and J. Turek.
"Progressive search and retrieval in large image archives." IBM J.
Res. Develop., 42, pp. 253-268, March 1998. [pdf]
●
I. Kontoyiannis.
"Second-order noiseless source coding theorems." IEEE Trans.
Inform. Theory, 43, pp. 1339-1341, July 1997. [pdf]
●
I. Kontoyiannis. "The
complexity and entropy of literary styles." NSF Technical Report no. 97,
Department of Statistics,
●
V. Castelli, I. Kontoyiannis,
C.S. Li, and J.J. Turek. "Progressive classification in the compressed
domain for large EOS satellite databases." 1996 IEEE International
Conference on Acoustics, Speech and Signal Processing.
[pdf]
●
I. Kontoyiannis, J. Turek, V.
Castelli and J. Robinson. "Multiresolution lossless image
compression." Unpublished manuscript, December 1995. [pdf]
● I. Kontoyiannis and Yu. M. Suhov.
"Prefixes and the entropy rate for long-range sources." In Probability
Statistics and Optimization: A tribute to Peter Whittle (F.P. Kelly ed.),
pp. 89-98, Wiley, 1994. [pdf]