Conformal Prediction under Hypergraphical Models

Conformal predictors are usually defined and studied under the exchangeability assumption. However, their definition can be extended to a wide class of statistical models, called online compression models, while retaining their property of automatic validity. This paper is devoted to conformal prediction under hypergraphical models that are more specific than the exchangeability model. Namely, we define two natural classes of conformity measures for such hypergraphical models and study the corresponding conformal predictors empirically on benchmark LED data sets. Our experiments show that they are more efficient than conformal predictors that use only the exchangeability assumption.

[1]  Torbjörn Ekman,et al.  Stepping Stones over the Refactoring Rubicon , 2009, ECOOP.

[2]  Henrik Boström,et al.  Evolved decision trees as conformal predictors , 2013, 2013 IEEE Congress on Evolutionary Computation.

[3]  Karsten Schwan,et al.  Region scheduling: efficiently using the cache architectures via page-level affinity , 2012, ASPLOS XVII.

[4]  Alexandra Fedorova,et al.  Addressing shared resource contention in multicore processors via scheduling , 2010, ASPLOS XV.

[5]  Birgitta König-Ries,et al.  Comparative social visualization for personalized e-learning , 2012, AVI.

[6]  Ivan Moore,et al.  Automatic inheritance hierarchy restructuring and method refactoring , 1996, OOPSLA '96.

[7]  Gongguo Tang,et al.  A game-theoretic approach for optimal time-of-use electricity pricing , 2013, IEEE Transactions on Power Systems.

[8]  Weng-Fai Wong,et al.  Dynamic cache contention detection in multi-threaded applications , 2011, VEE '11.

[9]  Patrice Marcotte,et al.  Bilevel programming: A survey , 2005, 4OR.

[10]  José Luiz Fiadeiro,et al.  An interface theory for service-oriented design , 2011, Theor. Comput. Sci..

[11]  Steven Swanson,et al.  Conservation cores: reducing the energy of mature computations , 2010, ASPLOS XV.

[12]  Zhengguo Li,et al.  Rate Control of H.264/AVC Scalable Extension , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  C.-C. Jay Kuo,et al.  Bit Allocation for Spatial Scalability Coding of H.264/SVC With Dependent Rate-Distortion Analysis , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  S. Kim,et al.  Fair cache sharing and partitioning in a chip multiprocessor architecture , 2004, Proceedings. 13th International Conference on Parallel Architecture and Compilation Techniques, 2004. PACT 2004..

[15]  Abdel Ejnioui,et al.  Control and data flow graph extraction for high-level synthesis , 2004, IEEE Computer Society Annual Symposium on VLSI.

[16]  Chen Chen,et al.  An innovative RTP-based residential power scheduling scheme for smart grids , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[18]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[19]  Hamed Mohsenian Rad,et al.  Optimal Residential Load Control With Price Prediction in Real-Time Electricity Pricing Environments , 2010, IEEE Transactions on Smart Grid.

[20]  Arnd Poetzsch-Heffter,et al.  Verifying backwards compatibility of object-oriented libraries using Boogie , 2012, FTfJP@ECOOP.

[21]  Graham R. Martin,et al.  Rate control for Scalable Video Coding with rate-distortion analysis of prediction modes , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[22]  Geoffrey E. Hinton,et al.  The Recurrent Temporal Restricted Boltzmann Machine , 2008, NIPS.

[23]  Craig B. Zilles,et al.  Discerning the dominant out-of-order performance advantage: is it speculation or dynamism? , 2013, ASPLOS '13.

[24]  Peter J. Denning,et al.  Certification of programs for secure information flow , 1977, CACM.

[25]  Matthias Jarke,et al.  The future of e-learning: a shift to knowledge networking and social software , 2007, Int. J. Knowl. Learn..

[26]  Patrick Th. Eugster,et al.  Semantics-aware trace analysis , 2009, PLDI '09.

[27]  Geoffrey Smith,et al.  A Sound Type System for Secure Flow Analysis , 1996, J. Comput. Secur..

[28]  Tom Routen,et al.  Intelligent Tutoring Systems , 1996, Lecture Notes in Computer Science.

[29]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[30]  J. Lofberg,et al.  YALMIP : a toolbox for modeling and optimization in MATLAB , 2004, 2004 IEEE International Conference on Robotics and Automation (IEEE Cat. No.04CH37508).

[31]  Vladimir Vovk,et al.  Conformal Prediction for Reliable Machine Learning: Theory, Adaptations and Applications , 2014 .

[32]  Mayer D. Schwartz,et al.  The Dexter Hypertext Reference Model , 1994, CACM.

[33]  Lars Kotthoff,et al.  Ensemble Classification for Constraint Solver Configuration , 2010, CP.

[34]  Vincent W. S. Wong,et al.  Optimal Real-Time Pricing Algorithm Based on Utility Maximization for Smart Grid , 2010, 2010 First IEEE International Conference on Smart Grid Communications.

[35]  Pierre Marquis,et al.  Reasoning under inconsistency: A forgetting-based approach , 2010, Artif. Intell..

[36]  Joshua J. Bloch How to design a good API and why it matters , 2006, OOPSLA '06.

[37]  Tom Mens,et al.  A case study to evaluate the suitability of graph transformation tools for program refactoring , 2010, International Journal on Software Tools for Technology Transfer.

[38]  A. Gammerman,et al.  On-line predictive linear regression , 2005, math/0511522.

[39]  Calton Pu,et al.  An Analysis of Performance Interference Effects in Virtual Environments , 2007, 2007 IEEE International Symposium on Performance Analysis of Systems & Software.

[40]  Artur S. d'Avila Garcez,et al.  A Connectionist Cognitive Model for Temporal Synchronisation and Learning , 2007, AAAI.

[41]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[42]  Lei Shi,et al.  SOCIAL E-LEARNING IN TOPOLOR: A CASE STUDY , 2013 .

[43]  Xiao-Jun Zeng,et al.  A Stackelberg Game Approach to maximise electricity retailer's profit and minimse customers' bills for future smart grid , 2012, 2012 12th UK Workshop on Computational Intelligence (UKCI).

[44]  R. Diaconescu Institution-independent model theory , 2008 .

[45]  Martin P. Robillard,et al.  A field study of API learning obstacles , 2011, Empirical Software Engineering.

[46]  Rong Zhang,et al.  Efficient Inter-Layer Motion Compensation for Spatially Scalable Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  Jean-Eric Pin,et al.  Infinite words - automata, semigroups, logic and games , 2004, Pure and applied mathematics series.

[48]  Lei Shi,et al.  Topolor: A Social Personalized Adaptive E-Learning System , 2013, UMAP.

[49]  Ian P. Gent,et al.  Minion: A Fast Scalable Constraint Solver , 2006, ECAI.

[50]  Antonija Mitrovic,et al.  Evaluating the Effect of Open Student Models on Self-Assessment , 2007, Int. J. Artif. Intell. Educ..

[51]  Gerhard Brewka Multi-context Systems: Specifying the Interaction of Knowledge Bases Declaratively , 2012, RR.

[52]  Shuvendu K. Lahiri,et al.  Differential assertion checking , 2013, ESEC/FSE 2013.

[53]  Stephen H. Kan,et al.  Metrics and Models in Software Quality Engineering , 1994, SOEN.

[54]  D. Carroll Chemical laser modeling with genetic algorithms , 1996 .

[55]  Wen Gao,et al.  Rate Control for Spatial Scalable Coding in SVC , 2007 .

[56]  Pao-Chi Chang,et al.  Fast inter-layer motion estimation algorithm on spatial scalability in H.264/AVC scalable extension , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[57]  Simon Rogers,et al.  A First Course in Machine Learning , 2011, Chapman and Hall / CRC machine learning and pattern recognition series.

[58]  Vikram S. Adve,et al.  LLVM: a compilation framework for lifelong program analysis & transformation , 2004, International Symposium on Code Generation and Optimization, 2004. CGO 2004..

[59]  Munchurl Kim,et al.  A fast mode selection scheme in inter-layer prediction of H.264 Scalable Extension coding , 2008, 2008 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[60]  Geoffrey E. Hinton,et al.  Deep Boltzmann Machines , 2009, AISTATS.

[61]  Hiroyuki Tomiyama,et al.  CHStone: A benchmark program suite for practical C-based high-level synthesis , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[62]  Peggy Seriès,et al.  Hallucinations in Charles Bonnet Syndrome Induced by Homeostasis: a Deep Boltzmann Machine Model , 2010, NIPS.

[63]  M. Annavaram,et al.  Energy per Instruction Trends in Intel ® Microprocessors , 2006 .

[64]  Laura Bocchi,et al.  Algebraic Semantics of Service Component Modules , 2006, WADT.

[65]  Gao Zi-You,et al.  A bi-level programming model and solution algorithm for the location of logistics distribution centers , 2008 .

[66]  Porfirio Tramontana,et al.  Using GUI ripping for automated testing of Android applications , 2012, 2012 Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering.

[67]  C. N. V. D. Wal Social Agents: Agent-Based Modelling of Integrated Internal and Social Dynamics of Cognitive and Affective Processes , 2012 .

[68]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[69]  Anindya Banerjee,et al.  State Based Encapsulation for Modular Reasoning about Behavior-Preserving Refactorings , 2013, Aliasing in Object-Oriented Programming.

[70]  Artur S. d'Avila Garcez,et al.  A Neural-Symbolic Cognitive Agent with a Mind's Eye , 2012, AAAI 2012.

[71]  He Li,et al.  Fast Mode Decision for Coarse Grain SNR Scalable Video Coding , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[72]  David Hovemeyer,et al.  Finding bugs is easy , 2004, SIGP.

[73]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[74]  W. Gasarch,et al.  The Book Review Column 1 Coverage Untyped Systems Simple Types Recursive Types Higher-order Systems General Impression 3 Organization, and Contents of the Book , 2022 .

[75]  Liang-Tien Chia,et al.  Study on the distribution of DCT residues and its application to R-D analysis of video coding , 2008, J. Vis. Commun. Image Represent..

[76]  David J. Spiegelhalter,et al.  Probabilistic Networks and Expert Systems , 1999, Information Science and Statistics.

[77]  Xiao Zhang,et al.  Towards practical page coloring-based multicore cache management , 2009, EuroSys '09.

[78]  Martin Gebser,et al.  Stream Reasoning with Answer Set Programming: Preliminary Report , 2012, KR.

[79]  Na Li,et al.  Optimal demand response based on utility maximization in power networks , 2011, 2011 IEEE Power and Energy Society General Meeting.

[80]  Siu-Ming Yiu,et al.  DroidChecker: analyzing android applications for capability leak , 2012, WISEC '12.

[81]  Wen Gao,et al.  Adaptive rate control for H.264 , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[82]  Ran Ettinger,et al.  Program Sliding , 2012, ECOOP.

[83]  Xin-Ping Guan,et al.  Optimal demand response scheduling with Stackelberg game approach under load uncertainty for smart grid , 2012, 2012 IEEE Third International Conference on Smart Grid Communications (SmartGridComm).

[84]  Lei Shi,et al.  Evaluating System Functionality in Social Personalized Adaptive E-Learning Systems , 2013, EC-TEL.

[85]  Lei Shi,et al.  Towards Understanding Learning Behavior Patterns in Social Adaptive Personalized E-Learning Systems , 2013, AMCIS.

[86]  Alexander Gammerman,et al.  Testing the Gauss linear assumption for on-line predictions , 2012, Progress in Artificial Intelligence.

[87]  Vesna M. Radonjic-Djogatovic,et al.  Responsive pricing modeled with Stackelberg game for next-generation networks , 2010, Ann. des Télécommunications.

[88]  Anand Sivasubramaniam,et al.  Storage performance virtualization via throughput and latency control , 2005, 13th IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[89]  Martial Mermillod,et al.  The Importance of Long-term Memory in Infant Perceptual Categorization , 2003 .

[90]  Lei Shi,et al.  Social Personalized Adaptive E-Learning Environment: Topolor - Implementation and Evaluation , 2013, AIED.

[91]  Pedro R. D'Argenio,et al.  Secure information flow by self-composition , 2004, Proceedings. 17th IEEE Computer Security Foundations Workshop, 2004..

[92]  Andy Philpott,et al.  An electricity market game between consumers, retailers and network operators , 2005, Decis. Support Syst..

[93]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[94]  Sung-Jea Ko,et al.  Adaptive mode decision algorithm for inter layer coding in scalable video coding , 2010, 2010 IEEE International Conference on Image Processing.

[95]  Xiao-Jun Zeng,et al.  Short-Term and Midterm Load Forecasting Using a Bilevel Optimization Model , 2009, IEEE Transactions on Power Systems.

[96]  Leonardo Mariani,et al.  Dynamic Analysis for Diagnosing Integration Faults , 2011, IEEE Transactions on Software Engineering.

[97]  Edward E. Smith,et al.  Cognitive Psychology: Mind and Brain , 2006 .

[98]  Gary J. Sullivan,et al.  Spatial Scalability Within the H.264/AVC Scalable Video Coding Extension , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[99]  Ofer Strichman,et al.  Regression verification , 2009, 2009 46th ACM/IEEE Design Automation Conference.

[100]  Jie Chen,et al.  The Complexity of Optimal Job Co-Scheduling on Chip Multiprocessors and Heuristics-Based Solutions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[101]  William F. Opdyke,et al.  Refactoring object-oriented frameworks , 1992 .

[102]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[103]  Graham R. Martin,et al.  Fast Inter-Mode Selection in the H.264/AVC Standard Using a Hierarchical Decision Process , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[104]  Preeti Ranjan Panda,et al.  The Impact of Loop Unrolling on Controller Delay in High Level Synthesis , 2007, 2007 Design, Automation & Test in Europe Conference & Exhibition.

[105]  Lei Shi,et al.  Evaluation of Social Interaction Features in Topolor - A Social Personalized Adaptive E-Learning System , 2013, 2013 IEEE 13th International Conference on Advanced Learning Technologies.

[106]  Martine Labbé Bilevel Programming and Price Setting Problems , 2006, OR.

[107]  H. Schwarz,et al.  Overview of the Scalable H.264/MPEG4-AVC Extension , 2006, 2006 International Conference on Image Processing.

[108]  Frédéric Saubion,et al.  Hybridization of Genetic Algorithms and Constraint Propagation for the BACP , 2005, ICLP.

[109]  Lei Shi,et al.  Designing social personalized adaptive e-learning , 2013, ITiCSE '13.

[110]  Thomas Eiter,et al.  Nonmonotonic Multi-Context Systems: A Flexible Approach for Integrating Heterogeneous Knowledge Sources , 2011, Logic Programming, Knowledge Representation, and Nonmonotonic Reasoning.

[111]  Monica S. Lam,et al.  Limits of control flow on parallelism , 1992, ISCA '92.

[112]  Thomas Stützle,et al.  Automatic Algorithm Configuration Based on Local Search , 2007, AAAI.

[113]  Vladimir Vovk,et al.  A tutorial on conformal prediction , 2007, J. Mach. Learn. Res..

[114]  Peter Xiaoping Liu,et al.  A game-theoretical decision-making scheme for electricity retailers in the smart grid with demand-side management , 2011, 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm).

[115]  Jinmi Kang,et al.  Fast mode decision for scalable video coding based on neighboring macroblock analysis , 2009, SAC '09.

[116]  Peter Müller,et al.  Changing Programs Correctly: Refactoring with Specifications , 2006, FM.

[117]  Yuanyuan Zhou,et al.  Bug characteristics in open source software , 2013, Empirical Software Engineering.

[118]  Graham R. Martin,et al.  Fast Mode Decision Algorithm for the H.264/AVC Scalable Video Coding Extension , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[119]  Martin Gebser,et al.  An incremental answer set programming based system for finite model computation , 2011, AI Commun..

[120]  James E. Smith,et al.  Virtual private caches , 2007, ISCA '07.

[121]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[122]  C.-C. Jay Kuo,et al.  Rate Control Optimization for Temporal-Layer Scalable Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[123]  Thomas Eiter,et al.  Equilibria in Heterogeneous Nonmonotonic Multi-Context Systems , 2007, AAAI.

[124]  Peter Brusilovsky,et al.  Adaptive Hypermedia , 2001, User Modeling and User-Adapted Interaction.

[125]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[126]  Sam Kwong,et al.  Fast inter-layer mode decision in Scalable Video Coding , 2010, 2010 IEEE International Conference on Image Processing.

[127]  Joseph A. Goguen,et al.  Institutions: abstract model theory for specification and programming , 1992, JACM.

[128]  Alan Christopher Lawrence,et al.  Optimizing compilation with the value state dependence graph , 2007 .

[129]  Alexander Gammerman,et al.  Conformal Prediction under Hypergraphical Models , 2013, ICCSW.

[130]  Vincent W. S. Wong,et al.  Autonomous Demand-Side Management Based on Game-Theoretic Energy Consumption Scheduling for the Future Smart Grid , 2010, IEEE Transactions on Smart Grid.

[131]  Cristina Gena,et al.  Usability Engineering for the Adaptive Web , 2007, The Adaptive Web.

[132]  Mahmut T. Kandemir,et al.  Adaptive set pinning: managing shared caches in chip multiprocessors , 2008, ASPLOS.

[133]  Shuvendu K. Lahiri,et al.  Towards Modularly Comparing Programs Using Automated Theorem Provers , 2013, CADE.

[134]  Sevgi Özkan,et al.  Multi-dimensional students' evaluation of e-learning systems in the higher education context: An empirical investigation , 2009, Comput. Educ..