**HOME
PUBLICATIONS
CV
PERSONAL
CLASSES**

FULL [LIST] OF
PUBLICATIONS

SELECTED PUBLICATIONS
& PREPRINTS:

PREPRINTS

● J. Taipale, I.
Kontoyiannis and S. Linnarsson. "Population-scale testing can suppress the
spread of infectious disease." Submitted. [pdf] Conference talk on **YouTube** [video] [slides]

● I.
Kontoyiannis, L. Mertzanis, A. Panotopoulou, I. Papageorgiou and M.
Skoularidou. "Bayesian Context Trees: Modelling and exact inference for
discrete time series." Submitted. [arXiv] Associated **R** package on CRAN [BCT]

● I. Kontoyiannis,
Y.H. Lim, K. Papakonstantinopoulou and W. Szpankowski. "Compression and
symmetry of small-world graphs and structures." Submitted. [arXiv]

● T.B. Berrett,
I. Kontoyiannis and R.J. Samworth. "Optimal rates for independence testing
via *U*-statistic permutation
tests." Submitted. [arXiv]
Associated **R** package on
CRAN [USP]

● L. Gavalakis
and I. Kontoyiannis. "Fundamental limits of lossless data compression with
side information." Submitted. [arXiv]

2016-PRESENT

● A.M. Devraj,
I. Kontoyiannis and S.P. Meyn. "Differential
temporal difference learning." To appear, *IEEE Trans.
Automatic Control*, 2021. [arXiv]

● I.
Papageorgiou, V.M. Lungu and I. Kontoyiannis. **R** package **BCT**: "Bayesian
Context Trees for Discrete Time Series." Version 0.1.1, November 2020, available
on CRAN [BCT]

● T.B. Berrett,
I. Kontoyiannis and R.J. Samworth. **R** package **USP**: "*U*-Statistic
Permutation Tests of Independence for all Data Types." Version 1.0, November
2020, available on CRAN [USP]

● R. Cavallari,
S. Toumpis, R. Verdone and I. Kontoyiannis. "Packet speed and cost in
mobile wireless delay-tolerant networks." *IEEE Trans. Information
Theory*, **66**, no. 9, pp. 5683-5702, September 2020. [arXiv]

● M. Riabiz, T.
Ardeshiri, I. Kontoyiannis and S Godsill. "Nonasymptotic Gaussian
approximation for inference with stable noise." *IEEE Trans. Information
Theory*, **66**, no. 8, pp. 4966-4991, August 2020. [arXiv]

● D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "A simple network of nodes
moving on the circle." *Random Structures & Algorithms*, **57**,
no. 2, pp. 317-338, July 2020. [arXiv]

● L. Gavalakis
and I. Kontoyiannis. "Sharp second-order pointwise asymptotics for
lossless compression with side information." *Entropy*, **22**,
no. 6, paper 705, June 2020. [arXiv]

● A.M. Devraj,
I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity in a weighted Sobolev
space." *Annals of Probability*, **48**, no. 1, pp.
308-403, January 2020. [arXiv]

● M. Madiman and
I. Kontoyiannis. "Entropy bounds on abelian groups and the Ruzsa
divergence." *IEEE Trans. Information Theory*, **64**, no. 1, pp. 77-92, January 2018. [arXiv]

● M. Riabiz, T.
Ardeshiri, I. Kontoyiannis and S Godsill. "Simulated convergence rates
with application to an intractable alpha-stable inference problem."
(invited paper) *IEEE International Workshop on
Computational Advances in Multi-Sensor Adaptive Processing*, Curaçao, Dutch Antilles, December 2017. [pdf]

● I.
Kontoyiannis and S.P. Meyn. "Approximating a diffusion by a finite-state
hidden Markov model." *Stochastic Processes and their
Applications*, **127**, no. 8, pp.
2482-2507, August 2017. [pdf] [arXiv]

● D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "Exact speed and transmission
cost in a simple one-dimensional wireless delay-tolerant network." *IEEE
International Symposium on Information Theory*, Aachen, Germany, June 2017.
[pdf]

● I.
Kontoyiannis and S.P. Meyn. "On the *f*-norm ergodicity of Markov
processes in continuous time." *Electronic Comm. in Probab.*,** 21**, paper 77,
pp. 1-10, November 2016. [pdf] [arXiv]

● I.
Kontoyiannis and M. Skoularidou. "Estimating the directed information and
testing for causality." *IEEE Trans. Information Theory*, **62**,
no. 11, pp. 6053-6067,
November 2016. [arXiv]

● **Book**: (in
Greek) I. Kontoyiannis and S. Toumpis. "*Elements
of Probability: With Applications in Statistics and Computer Science*."
Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation in Greek:*
*Γ. Κοντογιάννης και Σ. Τουμπής. *"Στοιχεία
πιθανοτήτων:
Με εφαρμογές
στη στατιστική
και την
πληροφορική". *Σύνδεσμος
Ελληνικών
Ακαδημαϊκών Βιβλιοθηκών,
Αθήνα, 2015.] ISBN: 978-960-603-182-3
[Official
Page] [Latest
Version] [Searchable pdf without hyperlinks]

● I.
Kontoyiannis and M. Madiman. "Sumset and inverse sumset inequalities for
differential entropy and mutual information." *IEEE Trans. Information
Theory*, **60**, no. 8, pp. 4503-4514, August 2014. [pdf]

● I.
Kontoyiannis and S. Verdú. "Optimal lossless data compression:
Non-asymptotics and asymptotics." *IEEE Trans. Information Theory*, **60**,
no. 2, pp. 777-795, February 2014. [pdf]

● Y. Altuğ,
I. Kontoyiannis and A.B. Wagner. "Lossless compression with moderate error
probability." *2013 IEEE International Symposium on Information Theory*,
Istanbul, Turkey, July 2013. [pdf]

● O. Johnson, I.
Kontoyiannis and M. Madiman. "Log-concavity, ultra-log-concavity and a
maximum entropy property of discrete compound Poisson measures." *Discrete Applied Mathematics* (Special
issue, Proceedings of the Jubilee Conference on Discrete Mathematics JCDM 2009,
D. J. Kleitman, A. Shastri, V. T. So's, eds.) **161**, no. 9, pp. 1232-1250,
June 2013. [pdf] See also earlier version on the [arXiv]

● C. Gioran and
I. Kontoyiannis. "Complexity-compression tradeoffs in lossy compression
via efficient random codebooks and databases." *Problems of Information Transmission*, **48**, Issue 4, pp.
376-394, October 2012. [pdf]

● I.
Kontoyiannis and S.P. Meyn. "Geometric ergodicity and the spectral gap of
non-reversible Markov chains." *Probability Theory and Related Fields*, **154**, Issue 1-2, pp.
327-339, October 2012. [pdf]

● V. Anantharam,
G. Caire, M. Costa, I. Kontoyiannis, G. Kramer, R. Yeung, and S. Verdú.
"Panel on *New Perspectives on
Information Theory*." (Invited discussion.) *IEEE Information Theory Society Newsletter*, pp. 21-27, March 2012.
[pdf]

● P. Dellaportas
and I. Kontoyiannis. "Control variates for estimation based on reversible
Markov chain Monte Carlo samplers." *Journal
of the Royal Statistical Society: Series B*, **74**, Part 1, pp. 133-161, 2012. [pdf]

● P.
Harremoës, O. Johnson and I. Kontoyiannis. "Thinning, entropy and the
law of thin numbers." *IEEE Trans. Inform. Theory*, **56**, no. 9, pp. 4228-4244, September 2010. [pdf]

● A.D. Barbour,
O. Johnson, I. Kontoyiannis and M. Madiman. "Compound Poisson
approximation via information functionals." *Electronic J. of Probab.*,
**15**, paper 42, pp. 1344-1368, August
2010. [pdf]

● A.
Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I. Kontoyiannis and E.
Upfal. "Probabilistic analysis of the *k*-server
problem on the circle." Unpublished manuscript, May 2010. [pdf]

● P. Dellaportas
and I. Kontoyiannis. "Notes on using control variates for estimation with
reversible MCMC samplers." *Notes*, July 2009. [arXiv]

2006-2008

● M. Harrison
and I. Kontoyiannis "Estimation of the rate-distortion function." *IEEE
Trans. Inform. Theory*, **54**, pp. 3757-3763, August 2008. [pdf] See also the longer version with additional results,
details and proofs on the [arXiv]

● I.
Kontoyiannis. "Book review: *"Information and complexity in
statistical modeling," by J. Rissanen, Springer, NY, 2007.*" *Amer.
Math. Monthly*, **115**, no. 10, pp. 956-960, December 2008. [pdf] [pdf]

● I.
Kontoyiannis and S.P. Meyn. "Computable exponential bounds for screened
estimation and simulation." *Ann. Appl. Probab.*, **18**, pp.
1491-1518, August 2008. [pdf]

● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy of binary time
series: Methodology, some theory and a simulation study." *Entropy,* 10, issue 2, pp. 71-99, June 2008. [pdf] [pdf]

● I. Kontoyiannis. "Counting the primes using entropy." *IEEE
Information Theory Society Newsletter*, **58**, no. 2, pp. 6-9, June
2008. [pdf] [pdf] Slides from a talk on this work at ITW 2008 in
Porto, May 2008. [pdf]

● I.
Kontoyiannis. "Some information-theoretic computations related to the
distribution of prime numbers." In *Festschrift in Honor of Jorma
Rissanen*, (P. Grunwald, P. Myllymaki, I. Tabus, M. Weinberger, B. Yu,
eds.), pp. 135-143,

● H.M. Aktulga,
I. Kontoyiannis, *EURASIP J.
Bioinform. Syst. Biol.*, vol. 2007, article ID 14741, 2007. [pdf]

● P.
Harremoës, O. Johnson and I. Kontoyiannis. "Thinning and the law of
small numbers." *2007 IEEE International Symposium on Information Theory*,
Nice, France, June 2007. [pdf]

● M. Madiman, O.
Johnson and I. Kontoyiannis. "Fisher information, compound Poisson
approximation, and the Poisson channel." *2007 IEEE International
Symposium on Information Theory*, Nice, France, June 2007. [pdf]

● I. Kontoyiannis,
*First International Conference on Performance Evaluation
Methodologies and Tools*,

● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "From the entropy to the statistical
structure of spike trains." *2006 IEEE International Symposium on
Information Theory*,

● I. Kontoyiannis
and M. Madiman. "Measure concentration for compound Poisson
distributions." *Electronic Comm. in Probab.*, **11**, paper 5,
pp. 45-57, May 2006. [pdf]

● I.
Kontoyiannis and R. Zamir. "Mismatched codebooks and the role of
entropy-coding in lossy data compression." *IEEE Trans. Inform. Theory*,
**52**, pp. 1922-1938, May 2006. [pdf] [pdf]

2003-2005

● I.
Kontoyiannis, *2005 IEEE International Symposium on
Information Theory*,

● I.
Kontoyiannis and B. Lucena. "Mutual information, synergy, and some curious
phenomena for simple channels." *2005 IEEE International Symposium on
Information Theory*,

● B. Lucena and
I. Kontoyiannis. "Filtering: The case for "noisier" data." *2005
IEEE Information Theory Workshop*,

● A.
Anagnostopoulos, I. Kontoyiannis and E. Upfal. "Steady state analysis of
balanced allocation routing." *Random Structures & Algorithms*, **26**,
pp. 446-467, July 2005. [pdf]

● I.
Kontoyiannis and S.P. Meyn. "Large deviations asymptotics and the spectral
theory of multiplicatively regular Markov processes." *Electronic J. of
Probab.*, **10**, paper 3, pp. 61-123, February 2005. [pdf] See also the slides from a
presentation on this work: [pdf]

● I.
Kontoyiannis, P. Harremoës and O. Johnson. "Entropy and the law of
small numbers." *IEEE Trans. Inform. Theory*, **51**, pp. 466-472,
February 2005. [pdf] [pdf]

● I.
Kontoyiannis and M. Madiman. "Entropy, compound Poisson approximation,
log-Sobolev inequalities and measure concentration." *2004 IEEE
Information Theory Workshop*,

● M. Madiman, M.
Harrison and I. Kontoyiannis. "Minimum Description Length vs. Maximum
Likelihood in lossy data compression." *2004 IEEE International
Symposium on Information Theory*,

● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy rate of spike
trains." *38th Annual Conference on Information Sciences and Systems*,

● I.
Kontoyiannis. "Pattern matching and lossy data compression on random
fields." *IEEE Trans. Inform. Theory*, **49**, pp. 1047-1051,
April 2003. [pdf]

● I.
Kontoyiannis and A.D. Sezer. "A remark on unified error exponents:
Hypothesis testing, data compression and measure concentration." *Barcelona
Conference on Stochastic Inequalities and Their Applications,* Spain, 2002;
published in *Progress in Probability,* vol. 56, pp. 23-32, Birkhauser,
Basel/Switzerland, 2003. [pdf]

● N. Merhav and
I. Kontoyiannis. "Source coding exponents for zero-delay coding with
finite memory." *IEEE Trans. Inform. Theory*, **49**, pp. 609-625,
March 2003. [pdf]

● I.
Kontoyiannis and S.P. Meyn. "Spectral theory and limit theorems for
geometrically ergodic Markov processes." *Ann. Appl. Probab.*, **13**,
pp. 304-362, February 2003. [pdf]

2000-2002

● M. Harrison
and I. Kontoyiannis. "Maximum likelihood estimation for lossy data
compression" (invited paper). *40th Allerton Conference on
Communication, Control and Computing*,

● V. Castelli
and I. Kontoyiannis. "An efficient recursive partitioning algorithm for
classification, using wavelets." APPTS
Report
#02-7, Division of Applied Math,

● J. Huang, I.
Kontoyiannis and S.P. Meyn. "The ODE method and spectral theory of Markov
operators." In *Proceedings of Stochastic Theory and Control Workshop*,
Springer,

● I.
Kontoyiannis and J. Zhang. "Arbitrary source models and Bayesian codebooks
in rate-distortion theory." *IEEE Trans. Inform. Theory*, **48**,
pp. 2276-2290, August 2002. [pdf]

● A. Dembo and
I. Kontoyiannis. "Source coding, large deviations, and approximate pattern
matching." Invited paper in *IEEE Trans. Inform. Theory* special
issue on Shannon theory, dedicated to Aaron D.
Wyner, **48**, pp. 1590-1615, June 2002. [pdf]

● A. Antos and
I. Kontoyiannis. "Convergence properties of functional estimates for
discrete distributions." *Random Structures & Algorithms*, **19**,
pp. 163-193. October 2001. [pdf]

● J. Zhang,
E.K.P. Chong and I. Kontoyiannis. "Unified spatial diversity combining and
power allocation schemes for CDMA systems." *IEEE J. on Selected Areas
in Comm.*, **19**, pp. 1276-1288, July 2001. [pdf]

● I.
Kontoyiannis. "Sphere-covering, measure concentration, and source
coding." *IEEE Trans. Inform. Theory*, **47**, pp. 1544-1552, May
2001. [pdf] [pdf]

● A. Dembo and
I. Kontoyiannis. "Critical behavior in lossy source coding." *IEEE
Trans. Inform. Theory*, **47**, pp. 1230-1236, March 2001. [pdf] [pdf]

● **Patent**: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,141,445. October 2000. [HTML]

● I.
Kontoyiannis. "Model selection via rate-distortion theory" (invited
paper). *34th Annual Conference on Information Sciences and Systems*,
March 2000. [pdf]

● **Patent**: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,021,224. February 2000. [HTML]

● I.
Kontoyiannis. "Pointwise redundancy in lossy data compression and
universal lossy data compression." *IEEE Trans. Inform. Theory*, **46**,
pp. 136-152, January 2000. [pdf]

1999 & EARLIER

● I.
Kontoyiannis. "An implementable lossy version of the Lempel-Ziv algorithm
-- Part I: Optimality for memoryless sources." *IEEE Trans. Inform.
Theory*, **45**, pp. 2293-2305, November 1999. [pdf]

● A. Dembo and
I. Kontoyiannis. "Critical behavior in data compression." Technical
Report no. TR-99-26, Department of Statistics,

● I.
Kontoyiannis. "Efficient sphere-covering and converse measure
concentration via generalized coding theorems." Technical Report no.
TR-99-26, Department of Statistics,

● A. Dembo and
I. Kontoyiannis. "The asymptotics of waiting times between stationary
processes, allowing distortion." *Ann. Appl. Probab.,* **9**, pp.
413-429, May 1999. [pdf]

● I.
Kontoyiannis. "Asymptotic recurrence and waiting times for stationary
processes." *J. Theoret. Probab.,* **11**, pp. 795-811, July 1998.
[pdf]

● I.
Kontoyiannis, P.H. Algoet, Yu. M. Suhov and A.J. Wyner. "Nonparametric
entropy estimation for stationary processes and random fields, with
applications to English text." *IEEE Trans. Inform. Theory*, **44**,
pp. 1319-1327, May 1998. [pdf]

● **Ph.D. Thesis**: "Recurrence and Waiting Times in Stationary
Processes, and their Applications in Data Compression." *Department of Electrical Engineering*, *Stanford University*, May 1998. [HTML]

● V. Castelli,
L. Bergman, I. Kontoyiannis, C.-S. Li, J. Robinson and J. Turek.
"Progressive search and retrieval in large image archives." *IBM J.
Res. Develop.,* **42**, pp. 253-268, March 1998. [pdf]

● I.
Kontoyiannis. "Second-order noiseless source coding theorems." *IEEE
Trans. Inform. Theory*, **43**, pp. 1339-1341, July 1997. [pdf]

● I.
Kontoyiannis. "The complexity and entropy of literary styles." NSF
Technical Report no. 97, Department of Statistics,

● V. Castelli,
I. Kontoyiannis, C.S. Li, and J.J. Turek. "Progressive classification in
the compressed domain for large EOS satellite databases." *1996 IEEE
International Conference on Acoustics, Speech and Signal Processing*. [pdf]

● I.
Kontoyiannis, J. Turek, V. Castelli and J. Robinson. "Multiresolution
lossless image compression." Unpublished manuscript, December 1995. [pdf]

●
I.
Kontoyiannis and Yu. M. Suhov. "Prefixes and the entropy rate for
long-range sources." In *Probability Statistics and Optimization: A
tribute to Peter Whittle *(F.P. Kelly ed.), pp. 89-98, Wiley, 1994. [pdf]