HOME
PUBLICATIONS
CV
PERSONAL
CLASSES
FULL [LIST] OF
PUBLICATIONS
SELECTED PUBLICATIONS
& PREPRINTS:
PREPRINTS
● J. Taipale, I.
Kontoyiannis and S. Linnarsson. "Population-scale testing can suppress the
spread of infectious disease." Submitted. [pdf] Conference talk on YouTube [video] [slides]
● I.
Kontoyiannis, L. Mertzanis, A. Panotopoulou, I. Papageorgiou and M.
Skoularidou. "Bayesian Context Trees: Modelling and exact inference for
discrete time series." Submitted. [arXiv] Associated R package on CRAN [BCT]
● I. Kontoyiannis,
Y.H. Lim, K. Papakonstantinopoulou and W. Szpankowski. "Compression and
symmetry of small-world graphs and structures." Submitted. [arXiv]
● T.B. Berrett,
I. Kontoyiannis and R.J. Samworth. "Optimal rates for independence testing
via U-statistic permutation
tests." Submitted. [arXiv]
Associated R package on
CRAN [USP]
● L. Gavalakis
and I. Kontoyiannis. "Fundamental limits of lossless data compression with
side information." Submitted. [arXiv]
2016-PRESENT
● A.M. Devraj,
I. Kontoyiannis and S.P. Meyn. "Differential
temporal difference learning." To appear, IEEE Trans.
Automatic Control, 2021. [arXiv]
● I.
Papageorgiou, V.M. Lungu and I. Kontoyiannis. R package BCT: "Bayesian
Context Trees for Discrete Time Series." Version 0.1.1, November 2020, available
on CRAN [BCT]
● T.B. Berrett,
I. Kontoyiannis and R.J. Samworth. R package USP: "U-Statistic
Permutation Tests of Independence for all Data Types." Version 1.0, November
2020, available on CRAN [USP]
● R. Cavallari,
S. Toumpis, R. Verdone and I. Kontoyiannis. "Packet speed and cost in
mobile wireless delay-tolerant networks." IEEE Trans. Information
Theory, 66, no. 9, pp. 5683-5702, September 2020. [arXiv]
● M. Riabiz, T.
Ardeshiri, I. Kontoyiannis and S Godsill. "Nonasymptotic Gaussian
approximation for inference with stable noise." IEEE Trans. Information
Theory, 66, no. 8, pp. 4966-4991, August 2020. [arXiv]
● D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "A simple network of nodes
moving on the circle." Random Structures & Algorithms, 57,
no. 2, pp. 317-338, July 2020. [arXiv]
● L. Gavalakis
and I. Kontoyiannis. "Sharp second-order pointwise asymptotics for
lossless compression with side information." Entropy, 22,
no. 6, paper 705, June 2020. [arXiv]
● A.M. Devraj,
I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity in a weighted Sobolev
space." Annals of Probability, 48, no. 1, pp.
308-403, January 2020. [arXiv]
● M. Madiman and
I. Kontoyiannis. "Entropy bounds on abelian groups and the Ruzsa
divergence." IEEE Trans. Information Theory, 64, no. 1, pp. 77-92, January 2018. [arXiv]
● M. Riabiz, T.
Ardeshiri, I. Kontoyiannis and S Godsill. "Simulated convergence rates
with application to an intractable alpha-stable inference problem."
(invited paper) IEEE International Workshop on
Computational Advances in Multi-Sensor Adaptive Processing, Curaçao, Dutch Antilles, December 2017. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Approximating a diffusion by a finite-state
hidden Markov model." Stochastic Processes and their
Applications, 127, no. 8, pp.
2482-2507, August 2017. [pdf] [arXiv]
● D. Cheliotis,
I. Kontoyiannis, M. Loulakis and S. Toumpis. "Exact speed and transmission
cost in a simple one-dimensional wireless delay-tolerant network." IEEE
International Symposium on Information Theory, Aachen, Germany, June 2017.
[pdf]
● I.
Kontoyiannis and S.P. Meyn. "On the f-norm ergodicity of Markov
processes in continuous time." Electronic Comm. in Probab., 21, paper 77,
pp. 1-10, November 2016. [pdf] [arXiv]
● I.
Kontoyiannis and M. Skoularidou. "Estimating the directed information and
testing for causality." IEEE Trans. Information Theory, 62,
no. 11, pp. 6053-6067,
November 2016. [arXiv]
2009-2015
● Book: (in
Greek) I. Kontoyiannis and S. Toumpis. "Elements
of Probability: With Applications in Statistics and Computer Science."
Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation in Greek:
Γ. Κοντογιάννης και Σ. Τουμπής. "Στοιχεία
πιθανοτήτων:
Με εφαρμογές
στη στατιστική
και την
πληροφορική". Σύνδεσμος
Ελληνικών
Ακαδημαϊκών Βιβλιοθηκών,
Αθήνα, 2015.] ISBN: 978-960-603-182-3
[Official
Page] [Latest
Version] [Searchable pdf without hyperlinks]
● I.
Kontoyiannis and M. Madiman. "Sumset and inverse sumset inequalities for
differential entropy and mutual information." IEEE Trans. Information
Theory, 60, no. 8, pp. 4503-4514, August 2014. [pdf]
● I.
Kontoyiannis and S. Verdú. "Optimal lossless data compression:
Non-asymptotics and asymptotics." IEEE Trans. Information Theory, 60,
no. 2, pp. 777-795, February 2014. [pdf]
● Y. Altuğ,
I. Kontoyiannis and A.B. Wagner. "Lossless compression with moderate error
probability." 2013 IEEE International Symposium on Information Theory,
Istanbul, Turkey, July 2013. [pdf]
● O. Johnson, I.
Kontoyiannis and M. Madiman. "Log-concavity, ultra-log-concavity and a
maximum entropy property of discrete compound Poisson measures." Discrete Applied Mathematics (Special
issue, Proceedings of the Jubilee Conference on Discrete Mathematics JCDM 2009,
D. J. Kleitman, A. Shastri, V. T. So's, eds.) 161, no. 9, pp. 1232-1250,
June 2013. [pdf] See also earlier version on the [arXiv]
● C. Gioran and
I. Kontoyiannis. "Complexity-compression tradeoffs in lossy compression
via efficient random codebooks and databases." Problems of Information Transmission, 48, Issue 4, pp.
376-394, October 2012. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Geometric ergodicity and the spectral gap of
non-reversible Markov chains." Probability Theory and Related Fields, 154, Issue 1-2, pp.
327-339, October 2012. [pdf]
● V. Anantharam,
G. Caire, M. Costa, I. Kontoyiannis, G. Kramer, R. Yeung, and S. Verdú.
"Panel on New Perspectives on
Information Theory." (Invited discussion.) IEEE Information Theory Society Newsletter, pp. 21-27, March 2012.
[pdf]
● P. Dellaportas
and I. Kontoyiannis. "Control variates for estimation based on reversible
Markov chain Monte Carlo samplers." Journal
of the Royal Statistical Society: Series B, 74, Part 1, pp. 133-161, 2012. [pdf]
● P.
Harremoës, O. Johnson and I. Kontoyiannis. "Thinning, entropy and the
law of thin numbers." IEEE Trans. Inform. Theory, 56, no. 9, pp. 4228-4244, September 2010. [pdf]
● A.D. Barbour,
O. Johnson, I. Kontoyiannis and M. Madiman. "Compound Poisson
approximation via information functionals." Electronic J. of Probab.,
15, paper 42, pp. 1344-1368, August
2010. [pdf]
● A.
Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I. Kontoyiannis and E.
Upfal. "Probabilistic analysis of the k-server
problem on the circle." Unpublished manuscript, May 2010. [pdf]
● P. Dellaportas
and I. Kontoyiannis. "Notes on using control variates for estimation with
reversible MCMC samplers." Notes, July 2009. [arXiv]
2006-2008
● M. Harrison
and I. Kontoyiannis "Estimation of the rate-distortion function." IEEE
Trans. Inform. Theory, 54, pp. 3757-3763, August 2008. [pdf] See also the longer version with additional results,
details and proofs on the [arXiv]
● I.
Kontoyiannis. "Book review: "Information and complexity in
statistical modeling," by J. Rissanen, Springer, NY, 2007." Amer.
Math. Monthly, 115, no. 10, pp. 956-960, December 2008. [pdf] [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Computable exponential bounds for screened
estimation and simulation." Ann. Appl. Probab., 18, pp.
1491-1518, August 2008. [pdf]
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy of binary time
series: Methodology, some theory and a simulation study." Entropy, 10, issue 2, pp. 71-99, June 2008. [pdf] [pdf]
● I. Kontoyiannis. "Counting the primes using entropy." IEEE
Information Theory Society Newsletter, 58, no. 2, pp. 6-9, June
2008. [pdf] [pdf] Slides from a talk on this work at ITW 2008 in
Porto, May 2008. [pdf]
● I.
Kontoyiannis. "Some information-theoretic computations related to the
distribution of prime numbers." In Festschrift in Honor of Jorma
Rissanen, (P. Grunwald, P. Myllymaki, I. Tabus, M. Weinberger, B. Yu,
eds.), pp. 135-143,
● H.M. Aktulga,
I. Kontoyiannis,
● P.
Harremoës, O. Johnson and I. Kontoyiannis. "Thinning and the law of
small numbers." 2007 IEEE International Symposium on Information Theory,
Nice, France, June 2007. [pdf]
● M. Madiman, O.
Johnson and I. Kontoyiannis. "Fisher information, compound Poisson
approximation, and the Poisson channel." 2007 IEEE International
Symposium on Information Theory, Nice, France, June 2007. [pdf]
● I. Kontoyiannis,
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "From the entropy to the statistical
structure of spike trains." 2006 IEEE International Symposium on
Information Theory,
● I. Kontoyiannis
and M. Madiman. "Measure concentration for compound Poisson
distributions." Electronic Comm. in Probab., 11, paper 5,
pp. 45-57, May 2006. [pdf]
● I.
Kontoyiannis and R. Zamir. "Mismatched codebooks and the role of
entropy-coding in lossy data compression." IEEE Trans. Inform. Theory,
52, pp. 1922-1938, May 2006. [pdf] [pdf]
2003-2005
● I.
Kontoyiannis,
● I.
Kontoyiannis and B. Lucena. "Mutual information, synergy, and some curious
phenomena for simple channels." 2005 IEEE International Symposium on
Information Theory,
● B. Lucena and
I. Kontoyiannis. "Filtering: The case for "noisier" data." 2005
IEEE Information Theory Workshop,
● A.
Anagnostopoulos, I. Kontoyiannis and E. Upfal. "Steady state analysis of
balanced allocation routing." Random Structures & Algorithms, 26,
pp. 446-467, July 2005. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Large deviations asymptotics and the spectral
theory of multiplicatively regular Markov processes." Electronic J. of
Probab., 10, paper 3, pp. 61-123, February 2005. [pdf] See also the slides from a
presentation on this work: [pdf]
● I.
Kontoyiannis, P. Harremoës and O. Johnson. "Entropy and the law of
small numbers." IEEE Trans. Inform. Theory, 51, pp. 466-472,
February 2005. [pdf] [pdf]
● I.
Kontoyiannis and M. Madiman. "Entropy, compound Poisson approximation,
log-Sobolev inequalities and measure concentration." 2004 IEEE
Information Theory Workshop,
● M. Madiman, M.
Harrison and I. Kontoyiannis. "Minimum Description Length vs. Maximum
Likelihood in lossy data compression." 2004 IEEE International
Symposium on Information Theory,
● Y. Gao, I.
Kontoyiannis and E. Bienenstock. "Estimating the entropy rate of spike
trains." 38th Annual Conference on Information Sciences and Systems,
● I.
Kontoyiannis. "Pattern matching and lossy data compression on random
fields." IEEE Trans. Inform. Theory, 49, pp. 1047-1051,
April 2003. [pdf]
● I.
Kontoyiannis and A.D. Sezer. "A remark on unified error exponents:
Hypothesis testing, data compression and measure concentration." Barcelona
Conference on Stochastic Inequalities and Their Applications, Spain, 2002;
published in Progress in Probability, vol. 56, pp. 23-32, Birkhauser,
Basel/Switzerland, 2003. [pdf]
● N. Merhav and
I. Kontoyiannis. "Source coding exponents for zero-delay coding with
finite memory." IEEE Trans. Inform. Theory, 49, pp. 609-625,
March 2003. [pdf]
● I.
Kontoyiannis and S.P. Meyn. "Spectral theory and limit theorems for
geometrically ergodic Markov processes." Ann. Appl. Probab., 13,
pp. 304-362, February 2003. [pdf]
2000-2002
● M. Harrison
and I. Kontoyiannis. "Maximum likelihood estimation for lossy data
compression" (invited paper). 40th Allerton Conference on
Communication, Control and Computing,
● V. Castelli
and I. Kontoyiannis. "An efficient recursive partitioning algorithm for
classification, using wavelets." APPTS
Report
#02-7, Division of Applied Math,
● J. Huang, I.
Kontoyiannis and S.P. Meyn. "The ODE method and spectral theory of Markov
operators." In Proceedings of Stochastic Theory and Control Workshop,
Springer,
● I.
Kontoyiannis and J. Zhang. "Arbitrary source models and Bayesian codebooks
in rate-distortion theory." IEEE Trans. Inform. Theory, 48,
pp. 2276-2290, August 2002. [pdf]
● A. Dembo and
I. Kontoyiannis. "Source coding, large deviations, and approximate pattern
matching." Invited paper in IEEE Trans. Inform. Theory special
issue on Shannon theory, dedicated to Aaron D.
Wyner, 48, pp. 1590-1615, June 2002. [pdf]
● A. Antos and
I. Kontoyiannis. "Convergence properties of functional estimates for
discrete distributions." Random Structures & Algorithms, 19,
pp. 163-193. October 2001. [pdf]
● J. Zhang,
E.K.P. Chong and I. Kontoyiannis. "Unified spatial diversity combining and
power allocation schemes for CDMA systems." IEEE J. on Selected Areas
in Comm., 19, pp. 1276-1288, July 2001. [pdf]
● I.
Kontoyiannis. "Sphere-covering, measure concentration, and source
coding." IEEE Trans. Inform. Theory, 47, pp. 1544-1552, May
2001. [pdf] [pdf]
● A. Dembo and
I. Kontoyiannis. "Critical behavior in lossy source coding." IEEE
Trans. Inform. Theory, 47, pp. 1230-1236, March 2001. [pdf] [pdf]
● Patent: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,141,445. October 2000. [HTML]
● I.
Kontoyiannis. "Model selection via rate-distortion theory" (invited
paper). 34th Annual Conference on Information Sciences and Systems,
March 2000. [pdf]
● Patent: "Multiresolution lossless/lossy compression and
storage of data for efficient processing thereof." With V. Castelli, J.
Robinson and J.J. Turek. U.S. Patent No. 6,021,224. February 2000. [HTML]
● I.
Kontoyiannis. "Pointwise redundancy in lossy data compression and
universal lossy data compression." IEEE Trans. Inform. Theory, 46,
pp. 136-152, January 2000. [pdf]
1999 & EARLIER
● I.
Kontoyiannis. "An implementable lossy version of the Lempel-Ziv algorithm
-- Part I: Optimality for memoryless sources." IEEE Trans. Inform.
Theory, 45, pp. 2293-2305, November 1999. [pdf]
● A. Dembo and
I. Kontoyiannis. "Critical behavior in data compression." Technical
Report no. TR-99-26, Department of Statistics,
● I.
Kontoyiannis. "Efficient sphere-covering and converse measure
concentration via generalized coding theorems." Technical Report no.
TR-99-26, Department of Statistics,
● A. Dembo and
I. Kontoyiannis. "The asymptotics of waiting times between stationary
processes, allowing distortion." Ann. Appl. Probab., 9, pp.
413-429, May 1999. [pdf]
● I.
Kontoyiannis. "Asymptotic recurrence and waiting times for stationary
processes." J. Theoret. Probab., 11, pp. 795-811, July 1998.
[pdf]
● I.
Kontoyiannis, P.H. Algoet, Yu. M. Suhov and A.J. Wyner. "Nonparametric
entropy estimation for stationary processes and random fields, with
applications to English text." IEEE Trans. Inform. Theory, 44,
pp. 1319-1327, May 1998. [pdf]
● Ph.D. Thesis: "Recurrence and Waiting Times in Stationary
Processes, and their Applications in Data Compression." Department of Electrical Engineering, Stanford University, May 1998. [HTML]
● V. Castelli,
L. Bergman, I. Kontoyiannis, C.-S. Li, J. Robinson and J. Turek.
"Progressive search and retrieval in large image archives." IBM J.
Res. Develop., 42, pp. 253-268, March 1998. [pdf]
● I.
Kontoyiannis. "Second-order noiseless source coding theorems." IEEE
Trans. Inform. Theory, 43, pp. 1339-1341, July 1997. [pdf]
● I.
Kontoyiannis. "The complexity and entropy of literary styles." NSF
Technical Report no. 97, Department of Statistics,
● V. Castelli,
I. Kontoyiannis, C.S. Li, and J.J. Turek. "Progressive classification in
the compressed domain for large EOS satellite databases." 1996 IEEE
International Conference on Acoustics, Speech and Signal Processing. [pdf]
● I.
Kontoyiannis, J. Turek, V. Castelli and J. Robinson. "Multiresolution
lossless image compression." Unpublished manuscript, December 1995. [pdf]
●
I.
Kontoyiannis and Yu. M. Suhov. "Prefixes and the entropy rate for
long-range sources." In Probability Statistics and Optimization: A
tribute to Peter Whittle (F.P. Kelly ed.), pp. 89-98, Wiley, 1994. [pdf]