HOME            PUBLICATIONS            CV            PERSONAL


 

FULL [LIST] OF PUBLICATIONS

 
SELECTED PUBLICATIONS & PREPRINTS:

PREPRINTS
 

     I. Papageorgiou and I. Kontoyiannis. "The Bayesian Context Trees State Space Model for time series modelling and forecasting." Submitted. [arXiv]

     A. Theocharous, G.G. Gregoriou, P. Sapountzis, and I. Kontoyiannis. "Temporally causal discovery tests for discrete time series and neural spike trains." Submitted. [arXiv]

     M. Berta, L. Gavalakis and I. Kontoyiannis. "A third information-theoretic approach to finite de Finetti theorems." Sumbitted. [arXiv]

     E.M. Loizidou, P. Barbounakis, S. Glentis, A. Dimopoulos, M. Anezaki, P. Rouskas, I. Kontoyiannis, N. Demiris, K. Rouskas, A.S. Dimas. "Periodic veganism in healthy individuals improves blood lipids, reduces low-grade inflammation, but impairs bone health: The FastBio study." Submitted. [medRxiv]

     V. Lungu, I. Papageorgiou and I. Kontoyiannis. "Change-point detection and segmentation of discrete data using Bayesian Context Trees. " Submitted. [arXiv] Associated R package on CRAN [BCT]

     V. Borkar, S. Chen, A. Devraj, I. Kontoyiannis and S.P. Meyn. "The ODE method for asymptotic statistics in stochastic approximation and reinforcement learning." Submitted. [arXiv]


2021-PRESENT

     L. Gavalakis and I. Kontoyiannis. "Entropy and the discrete central limit theorem." To appear, Stochastic Processes and Their Applications, 2024. [arXiv]

     I. Kontoyiannis. "Context-tree weighting and Bayesian Context Trees: Asymptotic and non-asymptotic justifications." To appear, IEEE Trans. Information Theory, 2024. [arXiv]

     I. Papageorgiou and I. Kontoyiannis. "Posterior representations for Bayesian Context Trees: Sampling, estimation and convergence." To appear, Bayesian Analysis, 2024. [arXiv]

     M. Tapia Costa, I. Kontoyiannis and S Godsill. "Generalised shot noise representations of stochastic systems driven by non-Gaussian Lévy processes." To appear, Journal of Applied Probability, 2024. [arXiv]

     I. Papageorgiou and I. Kontoyiannis. "Context-tree weighting for real-valued time series: Bayesian inference with hierarchical mixture models." 2023 IEEE International Symposium on Information Theory, Taipei, Taiwan, June 2023. [arXiv]

     I. Gavalakis and I. Kontoyiannis. "Information in probability: Another information-theoretic proof of a finite de Finetti theorem." In Mathematics Going Forward: Collected Mathematical Brushstrokes, (J.-M. Morel, B. Teissier, editors), pp. 367-385, Lecture Notes in Mathematics series, vol. 2313, Springer, Switzerland, May 2023. [arXiv]

     I. Papageorgiou and I. Kontoyiannis. "Truly Bayesian entropy estimation." 2023 IEEE Information Theory Workshop, Saint-Malo, France, April 2023. [arXiv]

     I. Kontoyiannis, L. Mertzanis, A. Panotopoulou, I. Papageorgiou and M. Skoularidou. "Bayesian Context Trees: Modelling and exact inference for discrete time series." Journal of the Royal Statistical Society: Series B, 84, no. 4, pp. 1287-1323, September 2022. [arXiv] Associated R package on CRAN [BCT]

     L. Tray and I. Kontoyiannis. "The feature-first block model." 36th International Workshop on Statistical Modelling, Trieste, Italy July 2022. Longer version: [arXiv]

     I. Kontoyiannis, Y.H. Lim, K. Papakonstantinopoulou and W. Szpankowski. "Compression and symmetry of small-world graphs and structures." Communications in Information and Systems, 22, no. 2, pp. 275-302, May 2022. [arXiv]

     I. Papageorgiou, V.M. Lungu and I. Kontoyiannis. R package BCT: "Bayesian Context Trees for Discrete Time Series." Version 1.2, May 2022, available on CRAN [BCT]

     P. Barmpounakis, N. Demiris, I. Kontoyiannis, G. Pavlakis and V. Sypsa. " Evaluating the effects of second-dose vaccine-delay policies in European countries: A simulation study based on data from Greece." PLoS ONE, 17(4): e0263977, April 2022. [medRxiv]

     L. Gavalakis and I. Kontoyiannis. "An information-theoretic proof of a finite de Finetti theorem." Electronic Comm. in Probab., 26, paper 68, pp. 1-5, December 2021. [arXiv]

     T.B. Berrett, I. Kontoyiannis and R.J. Samworth. "Optimal rates for independence testing via U-statistic permutation tests." Annals of Statistics, 49, no. 5, pp. 2457-2490, October 2021. [arXiv] Associated R package on CRAN [USP]

     A.M. Devraj, I. Kontoyiannis and S.P. Meyn. "Differential temporal difference learning." To IEEE Trans. Automatic Control, 66, no. 10, pp. 4652-4667 October 2021. [arXiv]

     S. Diggavi, A. El Gamal, I. Kontoyiannis, A. Paranjpe and M. Subbarao "Joy Thomas: Legacy, foundation and the IT society." IEEE BITS the Information Theory Magazine, 1, no. 1, pp. 85-88, August 2021. [IEEEXplore] [pdf]

     L. Gavalakis and I. Kontoyiannis. "Fundamental limits of lossless data compression with side information." IEEE Trans. Information Theory, 67, no. 5, pp. 2680-2692, May 2021. [arXiv]

     J. Taipale, I. Kontoyiannis and S. Linnarsson. "Population-scale testing can suppress the spread of infectious disease." arXiv manuscript, 2104.06857 [q-bio.PE], April 2021. [arXiv] Conference talk on YouTube [video] [slides]

 

2016-2020

 

     I. Papageorgiou, V.M. Lungu and I. Kontoyiannis. R package BCT: "Bayesian Context Trees for Discrete Time Series." Version 1.1, November 2020, available on CRAN [BCT]

     T.B. Berrett, I. Kontoyiannis and R.J. Samworth. R package USP: "U-Statistic Permutation Tests of Independence for all Data Types." Version 1.0, November 2020, available on CRAN [USP]

     R. Cavallari, S. Toumpis, R. Verdone and I. Kontoyiannis. "Packet speed and cost in mobile wireless delay-tolerant networks." IEEE Trans. Information Theory, 66, no. 9, pp. 5683-5702, September 2020. [arXiv]

     M. Riabiz, T. Ardeshiri, I. Kontoyiannis and S Godsill. "Nonasymptotic Gaussian approximation for inference with stable noise." IEEE Trans. Information Theory, 66, no. 8, pp. 4966-4991, August 2020. [arXiv]

     D. Cheliotis, I. Kontoyiannis, M. Loulakis and S. Toumpis. "A simple network of nodes moving on the circle." Random Structures & Algorithms, 57, no. 2, pp. 317-338, July 2020. [arXiv]

     L. Gavalakis and I. Kontoyiannis. "Sharp second-order pointwise asymptotics for lossless compression with side information." Entropy, 22, no. 6, paper 705, June 2020. [arXiv]

     A.M. Devraj, I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity in a weighted Sobolev space." Annals of Probability, 48, no. 1, pp. 308-403, January 2020. [arXiv]

     M. Madiman and I. Kontoyiannis. "Entropy bounds on abelian groups and the Ruzsa divergence." IEEE Trans. Information Theory, 64, no. 1, pp. 77-92, January 2018. [arXiv]

     M. Riabiz, T. Ardeshiri, I. Kontoyiannis and S Godsill. "Simulated convergence rates with application to an intractable alpha-stable inference problem." (invited paper) IEEE International Workshop on Computational Advances in Multi-Sensor Adaptive Processing, Curaçao, Dutch Antilles, December 2017. [pdf]

     I. Kontoyiannis and S.P. Meyn. "Approximating a diffusion by a finite-state hidden Markov model." Stochastic Processes and their Applications, 127, no. 8, pp. 2482-2507, August 2017. [pdf] [arXiv]

     D. Cheliotis, I. Kontoyiannis, M. Loulakis and S. Toumpis. "Exact speed and transmission cost in a simple one-dimensional wireless delay-tolerant network." 2017 IEEE International Symposium on Information Theory, Aachen, Germany, June 2017. [pdf]

     I. Kontoyiannis and S.P. Meyn. "On the f-norm ergodicity of Markov processes in continuous time." Electronic Comm. in Probab., 21, paper 77, pp. 1-10, November 2016. [pdf] [arXiv]

     I. Kontoyiannis and M. Skoularidou. "Estimating the directed information and testing for causality."  IEEE Trans. Information Theory, 62, no. 11, pp. 6053-6067, November 2016. [arXiv]

 
2009-2015
 

     Book: (in Greek) I. Kontoyiannis and S. Toumpis. "Elements of Probability: With Applications in Statistics and Computer Science."  Hellenic Academic Libraries Link, Ministry of Education, Athens, 2015. [Citation in Greek: Γ. Κοντογιάννης και Σ. Τουμπής. "Στοιχεία πιθανοτήτων: Με εφαρμογές στη στατιστική και την πληροφορική". Σύνδεσμος Ελληνικών Ακαδημαϊκών Βιβλιοθηκών, Αθήνα, 2015.] ISBN: 978-960-603-182-3 [Official Page] [Latest Version] [Searchable pdf without hyperlinks]

     I. Kontoyiannis and M. Madiman. "Sumset and inverse sumset inequalities for differential entropy and mutual information." IEEE Trans. Information Theory, 60, no. 8, pp. 4503-4514, August 2014. [pdf]

     I. Kontoyiannis and S. Verdú. "Optimal lossless data compression: Non-asymptotics and asymptotics." IEEE Trans. Information Theory, 60, no. 2, pp. 777-795, February 2014. [pdf]

     Y. Altuğ, I. Kontoyiannis and A.B. Wagner. "Lossless compression with moderate error probability." 2013 IEEE International Symposium on Information Theory, Istanbul, Turkey, July 2013. [pdf]

     O. Johnson, I. Kontoyiannis and M. Madiman. "Log-concavity, ultra-log-concavity and a maximum entropy property of discrete compound Poisson measures." Discrete Applied Mathematics (Special issue, Proceedings of the Jubilee Conference on Discrete Mathematics JCDM 2009, D. J. Kleitman, A. Shastri, V. T. So's, eds.) 161, no. 9, pp. 1232-1250, June 2013. [pdf] See also earlier version on the [arXiv] 

     C. Gioran and I. Kontoyiannis. "Complexity-compression tradeoffs in lossy compression via efficient random codebooks and databases." Problems of Information Transmission, 48, Issue 4, pp. 376-394, October 2012. [pdf]

     I. Kontoyiannis and S.P. Meyn. "Geometric ergodicity and the spectral gap of non-reversible Markov chains." Probability Theory and Related Fields, 154, Issue 1-2, pp. 327-339, October 2012. [pdf]

     V. Anantharam, G. Caire, M. Costa, I. Kontoyiannis, G. Kramer, R. Yeung, and S. Verdú. "Panel on New Perspectives on Information Theory." (Invited discussion.) IEEE Information Theory Society Newsletter, pp. 21-27, March 2012. [pdf] 

     P. Dellaportas and I. Kontoyiannis. "Control variates for estimation based on reversible Markov chain Monte Carlo samplers." Journal of the Royal Statistical Society: Series B, 74, Part 1, pp. 133-161, 2012. [pdf]

     P. Harremoës, O. Johnson and I. Kontoyiannis. "Thinning, entropy and the law of thin numbers." IEEE Trans. Inform. Theory, 56, no. 9, pp. 4228-4244, September 2010. [pdf]

     A.D. Barbour, O. Johnson, I. Kontoyiannis and M. Madiman. "Compound Poisson approximation via information functionals." Electronic J. of Probab., 15, paper 42, pp. 1344-1368, August 2010. [pdf]

     A. Anagnostopoulos, C. Dombry, N. Guillotin-Plantard, I. Kontoyiannis and E. Upfal. "Probabilistic analysis of the k-server problem on the circle." Unpublishe manuscript, May 2010. [pdf]

     P. Dellaportas and I. Kontoyiannis. "Notes on using control variates for estimation with reversible MCMC samplers." arXiv manuscript, 0907.4160 [stat.CO], July 2009. [arXiv]

 
2006-2008

     S. Kyriazopoulou-Panagiotopoulou, I. Kontoyiannis and S.P. Meyn. "Control variates as screening functions. " Third International Conference on Performance Evaluation Methodologies and Tools, Athens, Greece, October 2008. [pdf]

     M. Harrison and I. Kontoyiannis "Estimation of the rate-distortion function." IEEE Trans. Inform. Theory, 54, pp. 3757-3763, August 2008. [pdf] See also the longer version with additional results, details and proofs on the [arXiv]

     I. Kontoyiannis. "Book review: "Information and complexity in statistical modeling," by J. Rissanen, Springer, NY, 2007." Amer. Math. Monthly, 115, no. 10, pp. 956-960, December 2008. [pdf] [pdf]

     I. Kontoyiannis and S.P. Meyn. "Computable exponential bounds for screened estimation and simulation." Ann. Appl. Probab., 18, pp. 1491-1518, August 2008. [pdf]

     Y. Gao, I. Kontoyiannis and E. Bienenstock. "Estimating the entropy of binary time series: Methodology, some theory and a simulation study." Entropy, 10, issue 2, pp. 71-99, June 2008. [pdf] [pdf]

     I. Kontoyiannis. "Counting the primes using entropy." IEEE Information Theory Society Newsletter, 58, no. 2, pp. 6-9, June 2008. [pdf] [pdf] Slides from a talk on this work at ITW 2008 in Porto, May 2008. [pdf]

     I. Kontoyiannis. "Some information-theoretic computations related to the distribution of prime numbers." In Festschrift in Honor of Jorma Rissanen, (P. Grunwald, P. Myllymaki, I. Tabus, M. Weinberger, B. Yu, eds.), pp. 135-143, Tampere University Press, May 2008. [pdf] Slides from a talk on this work at ITW 2008 in Porto, May 2008. [pdf]

     H.M. Aktulga, I. Kontoyiannis, L.A. Lyznik, L. Szpankowski, A.Y. Grama and W. Szpankowski. "Identifying statistical dependence in genomic sequences via mutual information estimates." EURASIP J. Bioinform. Syst. Biol., vol. 2007, article ID 14741, 2007. [pdf]

     P. Harremoës, O. Johnson and I. Kontoyiannis. "Thinning and the law of small numbers." 2007 IEEE International Symposium on Information Theory, Nice, France, June 2007. [pdf]

     M. Madiman, O. Johnson and I. Kontoyiannis. "Fisher information, compound Poisson approximation, and the Poisson channel." 2007 IEEE International Symposium on Information Theory, Nice, France, June 2007. [pdf]

     I. Kontoyiannis, L.A. Lastras-Montaño and S.P. Meyn. "Exponential bounds and stopping rules for MCMC and general Markov chains." First International Conference on Performance Evaluation Methodologies and Tools, Pisa, Italy, October 2006. [pdf]

     Y. Gao, I. Kontoyiannis and E. Bienenstock. "From the entropy to the statistical structure of spike trains." 2006 IEEE International Symposium on Information Theory, Seattle, WA, July 2006. [pdf]

     I. Kontoyiannis and M. Madiman. "Measure concentration for compound Poisson distributions." Electronic Comm. in Probab., 11, paper 5, pp. 45-57, May 2006. [pdf]

     I. Kontoyiannis and R. Zamir. "Mismatched codebooks and the role of entropy-coding in lossy data compression." IEEE Trans. Inform. Theory, 52, pp. 1922-1938, May 2006. [pdf] [pdf]

 
2003-2005
 

     I. Kontoyiannis, L.A. Lastras-Montaño and S.P. Meyn. "Relative entropy and exponential deviation bounds for general Markov chains." 2005 IEEE International Symposium on Information Theory, Adelaide, Australia, September 2005. [pdf]

     I. Kontoyiannis and B. Lucena. "Mutual information, synergy, and some curious phenomena for simple channels." 2005 IEEE International Symposium on Information Theory, Adelaide, Australia, September 2005. [pdf]

     B. Lucena and I. Kontoyiannis. "Filtering: The case for "noisier" data." 2005 IEEE Information Theory Workshop, Rotorua, New Zealand, September 2005. [pdf]

     A. Anagnostopoulos, I. Kontoyiannis and E. Upfal. "Steady state analysis of balanced allocation routing." Random Structures & Algorithms, 26, pp. 446-467, July 2005. [pdf]

     I. Kontoyiannis and S.P. Meyn. "Large deviations asymptotics and the spectral theory of multiplicatively regular Markov processes." Electronic J. of Probab., 10, paper 3, pp. 61-123, February 2005. [pdf] See also the slides from a presentation on this work: [pdf]

     I. Kontoyiannis, P. Harremoës and O. Johnson. "Entropy and the law of small numbers." IEEE Trans. Inform. Theory, 51, pp. 466-472, February 2005. [pdf] [pdf]

     I. Kontoyiannis and M. Madiman. "Entropy, compound Poisson approximation, log-Sobolev inequalities and measure concentration." 2004 IEEE Information Theory Workshop, San Antonio, TX, October 2004. [pdf]

     M. Madiman, M. Harrison and I. Kontoyiannis. "Minimum Description Length vs. Maximum Likelihood in lossy data compression." 2004 IEEE International Symposium on Information Theory, Chicago, IL, July 2004. [pdf] See also the slides from a presentation on this work at an MSRI Workshop in February 2002. [pdf]

     Y. Gao, I. Kontoyiannis and E. Bienenstock. "Estimating the entropy rate of spike trains." 38th Annual Conference on Information Sciences and Systems, Princeton, NJ, March 2004. [pdf]

     Y. Gao, I. Kontoyiannis and E. Bienenstock. "Lempel-Ziv and CTW entropy estimators for spike trains." Invited paper, Estimation of entropy Workshop, 2003 Neural Information Processing Systems Conference, Vancouver, BC, Canada, December 2003. [pdf]

     I. Kontoyiannis. "Pattern matching and lossy data compression on random fields." IEEE Trans. Inform. Theory, 49, pp. 1047-1051, April 2003. [pdf]

     I. Kontoyiannis and A.D. Sezer. "A remark on unified error exponents: Hypothesis testing, data compression and measure concentration." Barcelona Conference on Stochastic Inequalities and Their Applications, Spain, 2002; published in Progress in Probability, vol. 56, pp. 23-32, Birkhauser, Basel/Switzerland, 2003. [pdf]

     N. Merhav and I. Kontoyiannis. "Source coding exponents for zero-delay coding with finite memory." IEEE Trans. Inform. Theory, 49, pp. 609-625, March 2003. [pdf]

     I. Kontoyiannis and S.P. Meyn. "Spectral theory and limit theorems for geometrically ergodic Markov processes." Ann. Appl. Probab., 13, pp. 304-362, February 2003. [pdf]

 
2000-2002
 

     M. Harrison and I. Kontoyiannis. "Maximum likelihood estimation for lossy data compression" (invited paper). 40th Allerton Conference on Communication, Control and Computing, Allerton, IL, October 2002. [pdf]

     V. Castelli and I. Kontoyiannis. "An efficient recursive partitioning algorithm for classification, using wavelets." APPTS Report #02-7, Division of Applied Math, Brown University, September 2002. [pdf]

     J. Huang, I. Kontoyiannis and S.P. Meyn. "The ODE method and spectral theory of Markov operators." In Proceedings of Stochastic Theory and Control Workshop, Springer, New York, pp. 205-221, B. Pasik-Duncan (Editor), 2002. [pdf]

     I. Kontoyiannis and J. Zhang. "Arbitrary source models and Bayesian codebooks in rate-distortion theory." IEEE Trans. Inform. Theory, 48, pp. 2276-2290, August 2002. [pdf]

     A. Dembo and I. Kontoyiannis. "Source coding, large deviations, and approximate pattern matching." Invited paper in IEEE Trans. Inform. Theory special issue on Shannon theory, dedicated to Aaron D. Wyner, 48, pp. 1590-1615, June 2002. [pdf]

     A. Antos and I. Kontoyiannis. "Convergence properties of functional estimates for discrete distributions." Random Structures & Algorithms, 19, pp. 163-193. October 2001. [pdf]

     J. Zhang, E.K.P. Chong and I. Kontoyiannis. "Unified spatial diversity combining and power allocation schemes for CDMA systems." IEEE J. on Selected Areas in Comm., 19, pp. 1276-1288, July 2001. [pdf]

     I. Kontoyiannis. "Sphere-covering, measure concentration, and source coding." IEEE Trans. Inform. Theory, 47, pp. 1544-1552, May 2001. [pdf] [pdf]

     A. Dembo and I. Kontoyiannis. "Critical behavior in lossy source coding." IEEE Trans. Inform. Theory, 47, pp. 1230-1236, March 2001. [pdf] [pdf]

     Patent: "Multiresolution lossless/lossy compression and storage of data for efficient processing thereof." With V. Castelli, J. Robinson and J.J. Turek. U.S. Patent No. 6,141,445. October 2000. [HTML]

     I. Kontoyiannis. "Model selection via rate-distortion theory" (invited paper). 34th Annual Conference on Information Sciences and Systems, March 2000. [pdf]

     Patent: "Multiresolution lossless/lossy compression and storage of data for efficient processing thereof." With V. Castelli, J. Robinson and J.J. Turek. U.S. Patent No. 6,021,224. February 2000. [HTML]

     I. Kontoyiannis. "Pointwise redundancy in lossy data compression and universal lossy data compression." IEEE Trans. Inform. Theory, 46, pp. 136-152, January 2000. [pdf]

 
1999 & EARLIER
 

     I. Kontoyiannis. "An implementable lossy version of the Lempel-Ziv algorithm -- Part I: Optimality for memoryless sources." IEEE Trans. Inform. Theory, 45, pp. 2293-2305, November 1999. [pdf]

     A. Dembo and I. Kontoyiannis. "Critical behavior in data compression." Technical Report no. TR-99-26, Department of Statistics, Purdue University, November 1999. [pdf]

     I. Kontoyiannis. "Efficient sphere-covering and converse measure concentration via generalized coding theorems." Technical Report no. TR-99-26, Department of Statistics, Purdue University, October 1999. [pdf] [pdf]

     A. Dembo and I. Kontoyiannis. "The asymptotics of waiting times between stationary processes, allowing distortion." Ann. Appl. Probab., 9, pp. 413-429, May 1999. [pdf]

     I. Kontoyiannis. "Asymptotic recurrence and waiting times for stationary processes." J. Theoret. Probab., 11, pp. 795-811, July 1998. [pdf]

     I. Kontoyiannis, P.H. Algoet, Yu. M. Suhov and A.J. Wyner. "Nonparametric entropy estimation for stationary processes and random fields, with applications to English text." IEEE Trans. Inform. Theory, 44, pp. 1319-1327, May 1998. [pdf]

     Ph.D. Thesis: "Recurrence and Waiting Times in Stationary Processes, and their Applications in Data Compression." Department of Electrical Engineering, Stanford University, May 1998. [HTML]

     V. Castelli, L. Bergman, I. Kontoyiannis, C.-S. Li, J. Robinson and J. Turek. "Progressive search and retrieval in large image archives." IBM J. Res. Develop., 42, pp. 253-268, March 1998. [pdf]

     I. Kontoyiannis. "Second-order noiseless source coding theorems." IEEE Trans. Inform. Theory, 43, pp. 1339-1341, July 1997. [pdf]

     I. Kontoyiannis. "The complexity and entropy of literary styles." NSF Technical Report no. 97, Department of Statistics, Stanford University, June 1996. [pdf]

     V. Castelli, I. Kontoyiannis, C.S. Li, and J.J. Turek. "Progressive classification in the compressed domain for large EOS satellite databases." 1996 IEEE International Conference on Acoustics, Speech and Signal Processing. [pdf]

     I. Kontoyiannis, J. Turek, V. Castelli and J. Robinson. "Multiresolution lossless image compression." Unpublished manuscript, December 1995. [pdf]

     I. Kontoyiannis and Yu. M. Suhov. "Prefixes and the entropy rate for long-range sources." In Probability Statistics and Optimization: A tribute to Peter Whittle (F.P. Kelly ed.), pp. 89-98, Wiley, 1994. [pdf]